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(54) 

(57) A data storage medium having stored thereon 
includes an audio sequence including at least one audio 
stream; at least one video s tream; and. r e p rod uc t i on 
control information for controlling reproduction off the at 
least one audio stream and the at least one video 
stream. The reproduction control information includes 
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reproduction order information defining the order of at 
least one video stream, among the at least one video 
stream stored on the data storage mediunrv-which is to 
be reproduced in synchronization with the audio 
sequence. 
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Description 

BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION: 

[0001 ] The present invention relates to a data storage 
medium having still picture data and audio data stored 
thereon, and an apparatus and method for reproducing 
the still picture data along with high quality audio data. 

2. DESCRIPTION OF THE RELATED ART: 

[0002] Conventionally known optical disks which 
music information including audio data or moving pic- 
ture information is recorded to and reproduced from 
include compact disks (CDs) and laser disks (LDs). 
Compact disk recorcfing and reproduction apparatuses 
and laser disk recording and reproduction apparatuses 
are conventfonally known apparatuses for recording 
and reproducing the above-mentioned information. 
[0003] A CD is an optical disk having a diameter of 1 2 
cm for storing music information digitally recorded using 
an encoding technology referred to as linear PCM. CDs 
have been utilized as a medium for storing data for 
music applications. An LD is an optical disk having a 
diameter of 30 cm for storing moving picture irtformation 
' with audio data recorded as an analog signal. LDs have 
been utilized as a medium for storing data for video 
applfoations such as movies. 

[0004] Recently, optical disks having a diameter of 
about 12 cm for storing music information and moving 
picture information including audio data digitally 
recorded. On such optical disks, either one or both of 
the music information and moving picture infonmatfon 
are efficiently recorded in the state of being digitally 
compressed in order to acquire longer recording times 
and higher quality. Some of such epical disks have a 
file structure which facilitates data exchange witii com- 
puters and communication apparatuses. 
[0005] In order to meet demands for mediums having 
higher quality recording and reproduction of audio infor- 
mation ttian CDs, tiie DVD-Video technology has been 
developed and put into practice for realizing high quality 
audio data reproduction of linear PCM, 96 kl-lz arxJ 24- 
bit sampling. However, the DVD-Video standards can- 
not provide high quality linear PCM multi-surround 
audio data reproduction or higher quality audio data 
reproduction. Accordingly, a higher quality technology 
has been in demand. However, the amount of high qual- 
ity audio data is quite large and tiius the reproduction 
speed of data required is quite high. Thus, it is difficult to 
record and reproduce image data along with the high 
quality audio data. 

[0006] In the case of reproducing an audio titie. there 
is a demand ttiat ttie image data be used as supplemen- 
tal data to the audio data as. for example, a so-called 
jacket picture such as lyrics and figure of the player. In 



order to realize this, recording and reproduction appara- 
tuses having more flexit)le and a wkier >mriety of func- 
tions are required. The functions include reproduction of 
video data synchronously witii high quality audio data. 

5 reproduction of video data asynchronously from audfo 
data, manipulation of video data by key operation, and 
special effects at the time of video data switching. 
[0007] There is another demand that data be repro- 
duced as the title creator intended. For example, the ini- 

10 tial operation when the disk is inserted should not be 
determined by the system used, and direct selection of 
the audfo data should be permitted or prohibited in 
accordance with the intention of the titie creator regard- 
less of the type of the player. 

15 [0008] Conventional optical disks, and recording and 
reproduction apparatuses generally have the above- 
described structure and thus have a problem in tiiat it is 
difficult to record and reproduce high quality digital 
audio data along with video data. N/Vhen the transfer 

20 speed of the high quality audio data is approximately 
equal to the reading speed of tiie optical disk, the video 
data cannot be reproduced along with the audio daUi by 
the method of multiplexing the audio data and the video 
data used in conventional apparatuses. The reason for 

25 this is tiiat vifhen the audio data and the video data are 
multiplexed, tiie transfer speed of tiie resultant data 
exceeds the reading speed of the optical disk and tiius 
the continuous reproduction of such data cannot be 
guaranteed. The method, often used in computer appli- 

30 cations, of appropriately buffering audio data and video 
data so as to simultaneously reproduce the audio data 
and tiie video data whfoh are recorded on different 
areas of tiie optical disk cannot be used. The reason for 
tills is that tiie sum of ttie transfer speeds of the audio 

35 data and the video data needs to be equal to or lower 
ttian the reproduction speed of tiie optical disk in order 
to continuously reproduce tiie data recorded on disks 
such as CDs for an hour or more. 
[0009] A Browsable reproduction method of switching 

40 the video data based on an instruction by tiie user while 
continuously reproducing the audio data, or a Slide- 
Show reproduction method of automatically switching 
the video data in synchronisation with a specified posi- 
tion in the audio data are not usable. 

45 

SUMMARY OF THE INVENTION 

[0010] According to one aspect of the invention, a 
data storage medium having stored thereon includes an 

50 audio sequence including at least one audio stream; at 
least one video stream: and reproduction control infor- 
mation for controlling reproduction of the at least one 
audio stream and the at least one video stream. The 
reproduction control information includes reproduction 

55 order information defining tiie order of at least one video 
stream, among the at least one video stream stored on 
the data storage medium, which is to be reproduced in 
synchronization with the audio sequence. 
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[001 1 ] In one embodiment of the invention, the repro- 
duction control information further includes video repro- 
duction mode information indicating whether it is 
possit)le or not to change the order of the at least one 
video stream to be reproduced in synchronization with i 
the audio sequence based on interaction from a user. 
[001 2] In one embodiment of the invention, the repro- 
duction control information further includes video repro- 
duction mode information indicating whether 
reproduction timing of the at least one video stream to 
be reproduced in synchronization with the audio 
sequence is defined or a reproduction time period 
thereof is defined. 

[001 3] In one embodiment of the invention, the repro- 
duction control information further includes reproduc- 
tion order mode information defining whether the at 
least one video stream, the order of which is defined by 
the reproduction order information, is reproduced ran- 
domly or sequentially, 

[001 4] In one erriDOdiment of the invention, the repro- 
duction order mode information indicates whether the at 
least one video stream is reproduced randomly while 
permitting overlap or randomly while prohibiting overlap. 
[001 5] In one embodiment of the invention, the audio 
sequence corresponds to at least one program, and the 
at least one video stream stored on the data storage 
medium is grouped on a program-by-program basis. 
[001 6] According to another aspect of the invention, 
an apparatus for reproducing information from a data 
storage medium having stored thereon an audio 
sequence including at least one audio stream: at least 
one video stream; and reproduction control information 
for controlling reproduction of the at least one audio 
stream and the at least one video stream, wherein the 
r^oduclion control information includes reproduction 
order information defining the order of at least one video 
stream, among the at least one video stream stored on 
the data storage medium, which is to be reproduced in 
synchronization with the audio sequence, the apparatus 
includes a reading section for reading the audio 
sequence and the at least one video stream stored on 
the data storage medium; and a reproduction section for 
reproducing the at least one video stream in synchroni- 
zation with the audio sequence in the order defined by 
reproduction order information. 

[0017] In one embodiment of the invention, the repro- 
duction control information further includes video repro- 
duction nrKXie information indicating whether it is 
possible or not to change the order of the at least one 
video stream to be reproduced in synchronization with 
the audio sequence based on interaction from a user. 
[001 8] In one embodiment of the invention, the repro- 
duction control information further includes video repro- 
duction mode information indicating whether 
reproduction timing of the at least one video stream to 
be reproduced in synchronization with the audio 
sequence is defined or a reproduction time period 
thereof is defined. 



[0019] In one embodiment of the invention, the repro- 
duction control infomiation furtiier includes reproduc- 
tion order mode infomiation defining whether the at 
least one video stream, the order of which is defined by 
5 the reproduction order information, is reproduced ran- 
domly or sequentially. 

[0020] In one embodiment of the invention, the repro- 
duction order mode information indicates whetiier the at 
least one video stream is reproduced randomly while 
10 permitting overlap or randomly while prohibiting overlap. 
[0021] In one embodiment Of the invention, the at least 
one video stream to be reproduced In synchronization 
with the audio sequence is t)uffered into a buffer located 
in the reproduction apparatus before reproduction of the 
IS audio sequence.- 

[0022] According to still another aspect of the inven- 
tion, a method for reproducing information from a data 
storage medium having stored thereon an audio 
sequence including at least one audio sti-eam; at least 
20 one video stream; and reproduction control information 
for cortrolling reproduction of the at least one audio 
stream and the at least one video stream, wherein tiie 
reproduction control information includes reproduction 
order information defining tiie order of at least one video 
2S stream, among tiie at least one video stream stored on 
the data storage medium, which is to be reproduced in 
synchronization with the audio sequence, the metfiod 
includes the steps of reading tiie audio sequence and 
the at least one video stream stored on the data storage 
30 medium; and reproducing tiie at least one video stream 
in sync^ironlzatlon with tiie audio sequence ill tt^e ord^r 

d^ined by reproduction order information. 
[0023] In one embodiment of the invention, the repro- 
duction confrol information further includes video repre- 
ss duction mode information indicating whether it is 
possible or not to change the order of tiie at least one 
video stream to be reproduced in synchronization witti 
the audio sequence based on interaction from a user. 
[0024] In one embodiment of the invention, the repro- 
40 duction control information further includes video repro- 
duction mode information indicating whether 
reproduction timing of the at least one video stream to 
be reproduced in synchronization witii tiie audio 
sequence is defined or a reproduction time period 
45 thereof is defined. 

[0025] In one embodiment of ttie invention. In one 
embodiment of the invention, the reproduction control 
infomiation further includes reproduction order mode 
infomiation defining whether the at least one video 
so stream, the order of which Is defined by ttie reproduc- 
tion order information, is reproduced randomly or 
sequentially. 

[0026] In one embodiment of the invention, the repro- 
duction order mode information indicates.whetiier tiie at 
55 least one video stream is reproduced randomly whDe 
permitting overlap or randomly while prohibiting overlap. 
[0027] In one embodiment of the invention, the at least 
one video stream to be reproduced in synchronization 
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with the audio sequence is buffered into a buffer located 
in the reproduction apparatus before reproduction of the 
audio sequence. 

[0028] According to stilt another aspect of the inven- 
tion, in a data storage medium stored with a first system s 
stream and a second system stream to be reproduced 
in synchronization with each other, the first system 
stream includes reproduction control information indi- 
cating timing at which the first system stream Is repro- 
duced, and the second system stream is reproduced at io 
timing determined by information other than information 
included in the second system stream. 
[0029] According to still another aspect of the inven- 
tion, an apparatus for reproducing a data storage 
medium stored with a first system stream and a second is 
system stream to be reproduced in synchronization with 
each other, the first system stream includes reproduc- 
tion control information indicating timing at which the 
first system stream is reproduced includes a reading 
section for reading the first system stream and the sec- 20 
ond system stream stored on the data storage medium; 
and a decoder section for decoding the first system 
stream in accordance with the reproduction corrtrol 
information. The second system stream is decoded in 
> accordance with a control signal supplied from outside 2S 
of the decoder section. 

[0030] According to still another aspect of the Inven- 
tion, a method for reproducing a data storage medium 
stored with a first system stream and a second system 
stream to be reproduced in synchronization with each 30 
other, wherein the first system stream includes repro- 
duction control information indicating timing at which the 
first system stream is reproduced includes the steps of 
reading the first system stream and the second system 
stream stored on the data storage medium; and control- 35 
ling the timing at which the first system stream is repro- 
duced in accordance with the reproduction corrtrol 
information; controlling the timing at which the second 
system stream is reproduced in accordance with infor- 
mation other than information included in the second 40 
system stream. 

[0031] Thus, the invention described herein makes 
possible the advantages of providing (1) an optical disk 
for realizing reproduction of high quality digital audio 
data along with video data in a restricted range of bit 4S 
rates; (2) an optical disK and an apparatus and method 
for reproducing data from such an optical disk for realiz-. 
ing switching between a mode in which high quality dig- 
ital audio data and video data are reproduced 
synchronously vwth each other and a mode in which so 
high quality digital audio data and video data are repro- 
duced asynchronously from each other and the vkieo 
data is switched based on time or by an instruction from 
the user; and (3) a reproduction apparatus for allowing 
a decoder used for a general MPEG2 stream to be used ss 
for reproducing audio data and video data as independ- 
ent streams and tiius for realizing reproduction of high 
quality digital audio data along with video data in a 



restricted range of bit rates at a relatively low cost. 
[0032] These and other advantages of the present 
invention will become apparent to those skilled in the art 
upon resding and understanding the following detailed 
description with reference to the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0033] 

Rgure 1 A is an external view of an optical disk In a 
first example according to the present invention; 

Figure IB is a cross-seOfonal view of the optical 
disk shown In Rgure 1 A; 

Figure 1C is an enlarged cross-sectional view of the 
optical disk shown in Figure 1 A; 

Figure ID shows pits formed in the c^cal disk in 
tiie first example according to the present invention; 

Rgure 2A shows a track structure of the optical disk 
shown in Figure 1 A; 

Figure 2B shows a sector structure of the optical 
disk shown in Rgure 1 A; 

Figure 3 shows a logical structure of the optical disk 
shown in Figure 1 A; 

Figure 4 shows a data structure of an audfo rnan- 
ager; 

Figure 5 shows a data structure of an audio title set; 

Figure 6 shows an exemplary structure of an audio 
object (AOS); 

Figure 7 shows a data structure of PGC information 
and cell information; 

Figure 8 is a block diagram showing an internal 
structure of a DVD player, which is a reproduction 
apparatus; 

Figure 9 shows an exanr^le of PGC forming a title; 

Rgure 10 shows an example of program informa- 
tion; 

Rgure 11 shows an example of cell information; 

Figure 12A shows a process for reproducing audio 
data writhout displaying a still picture; 

Rgure 128 shows a process for reproducing audfo 
data without displaying a still picture; 
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Figure 13A shows a process for reproducing audio 
data while displaying a still picture; 

Figure 13B shows a process for reproducing audio 
data while displaying a still picture; ^ 

Figure 14 shows a. conventional process for repro- 
ducing audio data; 

Figure 1 5 shows a schematic flow for reproducing a io 
program; 

Rgure 16 shows a schematic flow f6r reproducing a 
leading audio cell; 

IS 

Figure 17 shows a flow for reproducing a silent cell; 

Figure 18 shows a flow for reproducing a continu- 
ously reproduced cell; 

20 

Figure 19 is a DVD player and peripheral devices 
connected thereto; 

Figure 20 shows a remote controller used for oper- 
ating the DVD player; 

Figure 21 shows a logical structure of a DVD as a 
multimedia optical disk in a second example 
according to the present invention; 

30 

Figure 22 shows a structure of an audio manager; 

Figure 23 shows a data structure of an AOB of the 
DVD in the second example; 

35 

Figure 24 shows an exemplary structure of the 
ROB; 

Rgure 25 shows a data structure of PGC informa- 
tion of the DVD in the second example; ^ 

Figure 26 is a tAodK diagram showing an internal 
structure of a DVD player in the second example; 

Figure 27 is a block diagram showing an internal 45 
structure of a DVD player including a system 
decoder for AOB and P_VOB; 

Figure 28 is a block diagram showing an internal 
structure of a DVD player including a P_VOB buffer so 
immediately before an AV decoder section; 

Rgure 29 shows the relationship among PGC. 
audio program, cell, picture program, picture cell, 
AOB and P_VOB; ^s 

Figure 30 shows an example of program informa- 
tion forming a title; 



Rgure 31 shows a P„VOB of the DVD in the second 
example; 

Rgure 32 shows an exemplary audio program; 

Rgure 33 shows another exemplary audb program; 

Rgure 34 shows the number of silent cell packs and 
audio cell packs of audio data of 48 kHz. 16-bit 
sampling and 2 channels; 

Rgure'35 shows picture cell information when the 
number of still picture packs is 50; 

Rgures 36A and 36B show methods for reproduc- 
ing a silent cell and an audio cell; 

Rgure 37 is a flowchart illustrating a method for 
producing one of programs; 

Rgure 38 is a flowchart illustrating a method for 
producing one of the programs; 

Rgure 39 is a flowchart illustrating a method for 
producing one of the programs; 

Rgure 40 shows a video menu for allowing the user 
to select a title; 

Rgure 41 shows a structure of P_PCI; 

Rgure 42 shows a structure of P_DSI; 

Rgure 43 shows a logical structure of an optical 
disk in a third example according to the present 
invention; 

Rgure 44 shows a data structure off an audio man- 
ager (AMG); 

Rgure 45 shows a data structure of an audio still 
video set (ASVS); 

Rgure 46 shows a data structure of P_VOB: 

Rgure 47 shows a data structure of highlight infor- 
mation; 

Rgure 48 shows a data structure of an audio title 
set (ATS); 

Rgure 49 shows a data structure of PGC informa- 
tion (ATS_PGGI); 

Rgure 50 illustrates an audio still vkleo display 
mode; 

Rgure 51 shows a data structure of an MPEG sys- 
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t&Ti stream; 

Figure 52 shows the relationship among P_VOB, 
ASVU. ATS_PGCI and AOB; 

Rgure 53 shows an example of PGC information; 

Rgure 54 shows an example of audio program 
information (ATS.PGI); 

Figure 55 shows an example of ATS audio still 
video reproduction information (ATS„ASV_PBI); 

Figure 56 shows an example of cell information; 

Rgure 57 shows an example of ASV search 
pointer; 

Figure 58 shows an example of ASVU general 
information; 

Figure 59A shows the relationship between the 
audio reproduction timing and the still picture dis- 
play timing in the "SlideShow" mode; 

Rgure 598 shows the relationship between the 
audio reproduction timing and the still picture db- 
play timing in the "Browsable" nrKXie; 

Rgure 60 illustrates an audio still video display 
mode; 

Rgure 61 is a block diagram illustrating an internal 
structure of a DVD player as a reproduction appara- 
tus; 

Rgure 62 is a flowchart illustrating a method for 
reproducing PGC information; 

Figure 63 is a flowchart illustrating a method tor 
reproducing audio program; 

Figure 64 is a flowchart illustrating a method for 
determining key operation; 

Rgure 65 is a flowchart illustrating a method for 
reproducing audio data; 

Rgure 66 is a flowchart illustrating a method for 
reproducing a still picture; 

Figure 67 is a block diagram illustrating an internal 
structure of another DVD player as a reproduction 
apparatus; 

Rgure 68 is a block diagram illustrating an internal 
structure of still another DVD player as a reproduc- 
tion apparatus; and 



Rgure 69 illustrates tiie relationship betwe&i 
DUST and P.VOR 

DESCRIPTION OF THE EMBODIMENTS 

5 

[0034] Hereinafter, ttie present invention will be 
described by way of illustrative examples with reference 
to the accompanying drawings. 

10 (Example 1) 

[0035] An optical disk in a first example according to 
the present invention will be desaibed. 

75 (1) Physical structure of the optical disk 

[0036] Figure 1 A shews an external appearance of a 
DVD 107. which is a multimedia optical disk. Figure IB 
shows a cross-section of the DVD 107 taten along line 

20 A-A' in Figure 1 A. Figure 1C is an enlarged cross-sec- 
tional view of portion B shewn in Figure IB. 
[0037] As shown in Rgure 1 B, the DVD 1 07 is formed 
by sequentially laminating a first transparent substrate 
108, ah information layer 109, an adhesive layer 110, a 

25 second transparent substi-ate 111, and a print layer 112 
on which a label is to be printed in tiiis order. 
[0038] The first transparent substrate 108 and tiie 
second transparent substrate 111 are reinforcement 
substrates formed of the same material. In tiie example 

30 shown in Figure 1 B, these substrates each have a thick- 
ness of about 0.6 mm. These substrates can each have 
a thickness in the range between about 0.5 mm and 
about 0.7 mm. 

[0039] The adhesive layer 110 is provided between 
35 tiie information layer 109 and the second transparent 
substrate 111 in order to adhere the information ^lyer 
1 09 to the second transparent substrate 111. 
[0040] On the face of tiie information layer 1 09 in con- 
tact with the first transparent substrate 108 is formed a 
40 reflective film (not shown) formed of a tiiin metal film or 
tiie like. By using a molding technique, a high density of 
convex arxJ concave pits are formed in the reflective 
film. 

[0041 ] Figure 1 D shows the shapes of pits formed in 
45 the reflective film. In tiie example shown in Figure 1 D, 
each pit has a length of 0.4 ^m to 2.13 jim. A spiral track 
is formed in the DVD 107. The pits are formed alongskie 
the spiral track so as to be at a distance of 0.74 fim from 
the spiral track in a radial direction of the DVD 107, 
so Thus, an array of pits are formed along the spiral track 
[0042] When a light beam 1 1 3 is directed toward the 
DVD 107, a light spot 114 is formed on the information 
layer 1C© as shown in Figure 1C. The information stored 
on the DVD 107 is det«;ted as a variation in the refflect- 
55 ance of the portion of the information layer 119 which is 
irradiated by the light spot 114. 
[0043] The diameter of tiie light spot 1 14 of tiie DVD 
107 is about 1/1 .6 times the diameter of a light spot on 
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a CD because the numerical aperture (NA) of an object 
lens tor DVDs is larger than the numerical aperture of an 
object lens for CDs and because the wavelength A. of a 
light beam for DVDs is shorter than the wavelength X of 
a light beam for CDs. 

[0044] A DVD having the above-described physical 
structure can store about 4.7 Qbytes of information on 
one side. A storage capacity of about 4.7 Gbytes is 
nearly 8 times the storage capacity of a conventional 
CD. Such a large storing capacity of DVDs can greatly 
improve the quality of moving pictures and also greatly 
extend the reproducible time period of moving pictures. 
Whereas the reproducible time period of a conventional 
video CD Is 74 minutes, a DVD boasts a reproducible 
time period of 2 hours or more. 

[0045] The fundamental technology which realizes 
such a large storing capacity lies in reduction of the spot 
diameter d of a light beam. The spot diameter d is cal- 
culated from the formula: spot diameter d = laser wave- 
length A/numerical aperture NA of the object lens. 
Accordingly, the spot diameter d can be minimized by 
decreasing the laser wavelength X and increasing the 
numerical aperture NA of the object lens. It should be 
noted, however, that inaeasing the numerical aperture 
NA of the dbi&ct lens can result in coma aberration due 
to the relative slant of the optical axis of the light beam 
withrespedtothefaceof thedisk(i.e.. lilt"). Inthecase 
of DVDs, the coma aberration is minimized by reducing 
the thickness of a transparent substrate. However, 
reducing the thickness of a transparent substrate can 
result in another problem of lower mechanical sffengih 
of the disk. In the case of DVDs, the strength of the 
transparent sit)Strale is reinforced by attaching another 
substrate to the transparent substrate, thereby over- 
coming the problems associated with the mechanical 
strength off the disk. 

[0046] A red semiconductor laser having a short 
wavelength of 650 nm and an object lens having a large 
numerical aperture (NA) of about 0.6 mm are used to 
read the information stored on a DVD. By enploying a 
thin transparent substrate having a thickness of about 
0.6 mm in addition to the above-mentioned laser and 
object lens, it is possible to store about 4.7 Qbytes off 
information on one side off an optical disk having a diam- 
eter off 120 mm. 

[0047] Figure 2A schematically illustrates a spiral 
track 20 fformed from the inner periphery toward the 
outer periphery off the information layer 109 of the DVD 
107 (Figure 1 A). The spiral track 20 is divided into pre- 
scribed units referred to as sectors. In Figure 2A, the 
respective sectors are denoted by SI , S2, S99, and 
SI 00. The information stored on the DVD 107 is read on 
a sector-by-sector basis. 

[0048] Figure 2B shows an internal structure of a sec- 
tor, where the sector includes a sector header region 
21 [ a user data region 22, and an error correction code 
storage region 23. The sector header region 21 stores a 
sector address 



[0049] for identifying the sector and an error detection 
code therefor. Based on these sector addresses, a disk 
reproduction apparatos determines one of a plurality of 
sectors from which information shoukJ be read. 
5 [0050] The user data region 22 stores a 2 Kbyte long 
data string. 

[0051] The error conrection code storage region 23 
stores enor correction codes for the sector header 
region 21 and the user data region 22 included in the 
70 same sector. A disk reproduction apparatus performs 
OTor detection by using the error correction codes when 
reading data from the user data region 22 and pertbrms 
error correction based on the en-or detection results, 
thereby insuring the reliability of data reading. 



IS 



(2) Logical structure of the optical disk 



[0052] Figure 3 shows a logical structure of the DVD 
107 (Figure 1 A). As shown in Figure 3, the region of the 

20 DVD 107 is divided into a lead-in region 31, a volume 
region 32, and a lead-out region 33. These regions can 
be identified by identifficatton information included in 
sector addresses of physical sectors. The physical sec- 
tors are arrayed in an ascending order based on their 

25 sector addresses. 

[0053] In the lead-in region 31 , data for stabilizing the 
operation of a reproduction apparatus at the beginning 
of read, for example, is stored. 
[0054] No meaningful data is stored in the lead-out 

30 region 33. The lead-out region 33 is used for informing 
the disk reprOduCtiOri apparatus of the termination off 
reproduction. 

[0055] The volume region 32 stores digital data con-e- 
sponding to an application. The physical sectors 
35 included in the volume region 32 are managed as logi- 
cal blocks. The logical blocks are klentiffied by sequen- 
tial numbers (logical block nunrfoers) respectively 
assigned to the physical sectors after the first physical 
sector (designated as the 0th physical sector) in the vol- 
40 ume region 32. 

[0056] As shown in Figure 3, the volume region 32 is 
subdivided into a volume file management region 32a 
and an audio zone region 32c. 
[0057] The volume file management region 32a stores 
45 file system management information for managing a 
plurality of logical blocks as files in accordance witti 
IS013346. The file system management information is 
information indicating the correspondence between the 
name off each of a plurality of files and the addresses of 
so the logical blocks occupied by that file. A disk reproduc- 
tion apparatus achieves file-by-file access to the optical 
disk based on the file system management information. 
Speciffically. the disk reproduction apparatus refers to 
the file system management information to obtain the 
55 addresses off the logical blocks conresponding to a given 
file name, and accesses the logical blocks based on 
these addresses. As a result, the digital data contained 
in a desired f ile can be read. 
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[0058] An audio zone region 32c stores an audio man- 
ager 900 and one or more audio title sets 800. 
[0059] The audio title set 800 contains a plurality of 
pieces of audio data and management information for 
managing the order of reproducing the plurality of 
pieces of audio data. An audio title set 800 has a data 
structure which allows for management of the audio 
data in units which are refened to as audio titles. Typi- 
cally, an audio title conresponds to a music album con- 
taining one or more tunes. 

(3) Data structure of the audio zone region 32c 

[0060] The audio zone region 32c stores an audio 
manager 900 and one or more audio title sets 800. 

(3.1) Data structure of the audio title set 800 

[0061 ] Figure 5 shows a data structure of an audio title 
set 800. The audio title set 800 includes a plurality of 
audio objects (hereinafter, referred to as "AOBs") 802, 
audio title set management information (ATSI) 801 for 
managing the order of reproducing the plurality of AOBs 
802, and audio title set management information 
backup (ATSLBUP) 804 which is backup data of the 
audio title set management information 801. In the fol- 
lowing description, an "audio title set" will generally be 
refen^ed to as an "ATS". 

(3.1 .1) Data structure of the AOB 802 

[0062] The AOB iB02 is packetized into 2 Kbytes. The 
AOB 802 stores data in the LPCM format, AC3 format, 
DTS format or other compression formats. In the case 
of the LPCM format, the sample bit is 1 6. 20, or 24 bits, 
with a sanpling frequency of 48 kHz. 96 kHz, 192 kHz. 
44.1 kHz. 88.2 kHz, or 176.4 kHz. 

(3.1 .2) Data structure of the audio title set management 
information 801 

[0063] The audio title set management information 
(ATSI) 801 includes information for managing tiie order 
of reproducing the AOBs 802. The order of reproducing 
the AOBs 802 is designated by a program chain (PGC). 
as in the case of video objects (VOBs), Different PGCs 
can define different orders of reproduction of AOBs 802. 
[0064] As shown in Figure 5, the audio title set man- 
agement information (ATSI) 801 includes an ATS man- 
agement table (ATSLMAT) 811 and a PGC 
management information table (ATS.PGCIT) 812. 
[0065] The ATS management tat>ie 811 serves as 
header information of the audio title set management 
information 801. The ATS management table 811 
includes a pointer indicating a region in which each 
AOB 802 is stored, a pointer indicating a region in which 
the PGC management information table 812 is stored, 
and attribute information on each AOB 802. In the case 



where a still picture is stored on the DVD 107 (Figure 
1A). the ATS management table 811 also includes 
attribute information and the like for the still picture. 
[0066] The PGC management information table 
5 (ATS^PGCIT) 812 includes ATS PGC management 
table information (ATS.PGCITI) 831, a plurality of ATS 
PGC information search pointers (ATS_PGCLSRPs) 
832, and a plurality of PGC information (ATS.PGCI) 
units 833. 

10 [0067] The ATS PGC infbrmatiwri search pointers 
(ATS_PGCLSRPs) 832 are indices for a plurality of 
PGCs stored in the PGC management information table 
812 and designate the PGC information to be executed 
first on a titie-by-titie basis. 

15 [0068] Each of the PGC information urdts descrlt^es 
positions on the optical disk 107 where one or more 
audio objects are recorded and the order of reproduc- 
tion tiiereof. Reproductk>n of the same audio object can 
be described by different PGC information. Specifically. 

20 each PGC information unit includes "ATS PGC general 
information (ATS_PGC_GI)", "ATS program information 
table (ATS^PGIT)". and "audio cell reproduction infor- 
mation table (ATS_C_PBIT)". 

[0069] Figure 7 shows a data structure of each PGC 

25 information unit. As shown in Figure 7, "ATS PGC gen- 
eral information (ATS_PGC_GI)" includes the number of 
programs and the number of cells included in the PGC 
information, the reproduction time period of the PGC. 
and information on pointers to "ATS program infbrma- 

30 tion table (ATS^PGIT)" and to "audio cell reproduction 
information table (ATS_C_PBIT)". 
[0070] The "ATS program information table 
(ATS_PGIT)" includes "program physteal altocation 
information" indicating whetiier or not the AOB of each 

35 program and tiie AOB of the previous program are 
recorded at physically discontinuous positions on tiie 
optical disk, "program time attribute information" indicat- 
ing whether or not the time information of tiie AOB is 
continuous with tiie time information of the previous 

40 AOB, "program start cell number" indicating the first cell 
number forming the program, "program stai picture flag" 
indicating whether or not the program includes a still 
picture, "reproduction start audio cell time" indicating 
the first time information of the first audio cell included in 

45 the program, "program total reproduction time period" 
indicating ttie reproduction time period of tiie program, 
and "audio pause time period" irKlicating the silent 
period until the reproduction of the audio cell of the pro- 
gram starts. 

so [0071] The "audio cell reproduction information table 
(ATS_C_PBIT)" stores cell information forming the AOB 
to be reproduced. Specifically, the "ATS cell reproduc- 
tion information table" includes "cell index number" indi- 
cating the order of cells included in the program, "cell 

55 type" indicating tfie attribute of the cell (i.e.. whether tiie 
cell is a still pk;ture ceil, a silent cell or an audio cell), 
"cell start address" indicating the start address of the 
cell in tiie form of a relative address with respect to the 
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first pack of the AOB of the ATS including the cell* and 
"cell termination address" indicating the final address of 
the cell in the same manner 

[0072] Figure 6 shows an exemplary structure of the 
AOB. The AOB is part of an MPEG2 stream and 
iricludes a still picture cell including a still picture pacK a 
silent cell including an audio pack including substan- 
tially silent audio data, and an audio cell including an 
audio pack of audio data forming a tune. The AOB 
includes one or more audio cells and may not include a 
still picture cell or a silent cell. Still picture cells are 
never continuous with each other arxJ silent cells are 
never continuous with each other A still picture cell is 
always followed by a silent cell or an audio cell. A silent 
cell is always followed by an audio celL In the example 
shown in Figure 6, audio cells and silent cells exist and 
are physically continuous. Time information is also con- 
tinuous; i.a, the "program physical allocation informa- 
tion" has a value representing "continue", and the 
"program time attribute information" sdso has a value 
representing "continue". 

[0073] In Figure 6, the line passing through points B, 
C, E, F and G represents a change in the value of the 
time information (i.e.. PTS) of the AOB. Point A repre- 
sents a value of the PTS of the still picture cell: Point B 
represents a value of the first PTS of a silent cell. Point 
C represents a value of the first PTS of an audio cell. 
Thus, the PTS of a silent cell is continuous to the PTS of 
an audio cell, and there is no data underflow gap, as 
referred to with respect to the MPEG2 stream, between 
the silent ceH andihe audio celh Point B,- at which the 
value of the PTS of the silent cell is larger than the value 
of the PTS of the still picture cell, represents that a still 
picture in the still picture cell is displayed before the 
reproduction of the silent cell starts. The PTS of the next 
still picture cell is represented by point D, and the PTS 
of the next silent cell is represented by point E. In the 
case where the PTS of the still picture cell and the PTS 
of the silent cell have an equal value, the reproduction of 
the silent cell starts simultaneously when the still picture 
is displayed. The difference between the first PTS of the 
next audio cell at point F and the final PTS of the audio 
cell at point D is "audio pause time period". Since the 
gap between the PTS's needs to be 0.7 seconds or less 
as specified by MPEG2. the difference at point B 
between the first PTS of the silent cell and the PTS of 
the still picture cell, and the difference at point D 
between the first PTS of the still picture cell and the final 
PTS of the audio cell need to fulfill such a condition. 
[0074] Figure 9 shows an exemplary PGC forming a 
titie. The example shown in Figure 9 includes five pro- 
grams. Programs #1 and #2 con-espond to AOB #1 . and 
programs #3. #4 and #5 con-espond to AOB #2. On the 
information storing medium, AOB #1 is recorded after 
AOB #2. Programs #1 and #2 both include a still picture 
cell and a silent cell, and program #2 includes two audio 
cells. Programs #3 and #4 includes only a silent cell, 
and program #5 includes only an audio cell. 



[0075] In the case where all the audio cells each have 
a reproduction time period of 60 seconds (5.400.000 in 
PTS). all the silent cells each have a reproduction time 
period of 1 second (90,000 in PTS). and the PTS of the 

5 still picture cell has the same value as that of the first 
PTS of the silent c^l. program Information can be 
described as shown in Figure 10. Under the conditions 
that the size of the still picture data is about 1 .88 Mbits 
and the audio data is 48 kHz. 16 bit sampling with 2 

to channels, the number of the still picture packs is 112. 
the number of the silent cell packs is 96. and the 
nurrtier of the audio cell packs is 5760 as shown in Fig- 
ure 11. 

[0076] The audio title set has been descrft>ed. Next. 
75 with reference to Figure 4, the audio manager will be 
descrit^. 

(3.2) Data structure of the audio manager 900 

20 [0077] The audio manager 900 is information for con- 
trolling the reproduction which is to be first referred to for 
performing audio-oriented reproduction of the informa- 
tion on the optical disk by a reproduction apparatus. 
[0078] Figure 4 shows a data structure of the audio 

25 manager 900. 

[0079] The audio manager 900 includes "audio man- 
ager information (AMGD". "VOB for audio manager 
menu (AMGM_VOBS)". and "audio manager informa- 
tion backup (AMGLBUP)". 

30 [0080] The "audio manager information (AMGI)" 
includes "audio manager information management 
table (AMGLMAT)" including attribute information and 
pointer information, "audfo title management informa- 
tion" indicating the number of audio titles and the like, 

35 "audio title search pointer (ATT^SRP)" indicating search 
infbmiation on the audio tities. and "audio manager 
menu PGC management information table 
(AMQM_PGCI_UT)" indicating PGC information for 
audio manager menu. 

40 [0081] Each "audio fitie search pointer (ATT_SRP)" 
includes "audio title type" indicating the type of each 
title, "number of progranre in the titles" indicating the 
number of programs included in the titles, "title repro- 
duction time period" indicating the reproduction time 

45 period of the tities. "ATS number" indicating the set 
nurriber of the ATS to which each titie belongs. "ATS titie 
nuni>er indicating the titie number of each t'ltie in the 
ATS. and "ATS address" indicating tiie address of the 
ATS to which each titie belongs. 
so [0082] The audio zone region and the DVD as a mul- 
timedia optical disk have been described. Next, a repro- 
duction apparatus according to the present Invention 
will be described. 

[0083] First an external appearance of a DVD player 
55 which is a reproduction apparatus for multimedia optical 
disks will be desaibed. Figure 19 shows external 
appearances of a DVD player 1, a TV monitor 2 and a 
remote controller 91. 
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[0084] The DVD player 1 has an opening in a front 
lace of a chassis thereof, and includes a driving mecha- 
nism for loading an optical disk in the depth direction of 
the opening. 

[0085] Provided on the front face of the DVD player 1 
is a remote control receiving section 92 having a light 
receiving element for receiving infrared rays emitted by 
the remote controller 91. When an operator uses a 
remote controller held in his/her hand, the remote con- 
trol receiving section 92 sends an interrupt signal indi- 
cating that a key signal has l>een received. 
[0086] Provided on a rear lace of the DVD player 1 are 
video and audio output ta-minals. A video signal repro- 
duced from the DVD can be output to the large TV mon- 
itor 2 for home use by connecting an AV cord to the 
video and audio output terminals. Thus, the operator 
can enjoy the video reproduced from the DVD on a large 
TV of, for example. 33 inches or 35 inches. As can be 
appreciated from the above description, the DVD player 
1 in this example is not used in the state of being con- 
nected to a personal computer but is used with the TV 
monitor 2 as an electronic appliance for home use. 
[0087] The remote controller 91 includes a spring- 
loaded keypad on a surface of a casing thereof, and out- 
puts a code corresponding to a pressed key by infrared 
rays. Figure 20 shows an operation panel of the renfKrte 
controller 91. The "POWER" key on the operation panel 
is for turning the DVD player 1 ON or OFF. The "MENU" 
key is used for retrieving the volume menu of the optical 
disk during reproduction of the program chain. Ten keys 
are used for, for example, chapter-jumping the movie or 
selecting music tunes. Upward, downward, leftward and 
rightward cursor keys are used for selecting tievns. The 
"ENTER" key is used for confirming an item selected by 
the cursor. When the cursor is moved on items by the 
upward, downward, leftwvard and rightward cursor keys, 
the item on which the cursor is positioned is displayed 
with a select color of item color information of the man- 
agement intormation pack. When the item is confirmed 
by the "Ef>JTER" key. the item is displayed with a confir- 
mation color. In addition, there are keys which are com- 
mon with other AV apparatuses such as, for example. 
-PLAY". "STOP", "PAUSE", "FORWARD" and 
"REWIND" keys. 

[0088] Next, the structure of the DVD player, which is 
a reproduction apparatus for multimedia optical disks 
will be described. 

[0089] Rgure 8 is a block diagram of an internal struc- 
ture of a DVD player 70. The DVD player 70 includes a 
driving mechanism 81, an optical pickup 82, a mecha- 
nism control section 83, a signal processing section 84, 
an AV decoder section 85, a remote control receiving 
section 92 and a system control section 93. 
[0090] The driving mechanism 81 includes a table on 
which an optical disk is set and a spindle motor for 
clamping and rotating the optical disk which is set on the 
table. The table is structured to be moved in and out of 
the chassis by an eject mechanism not shown. When 



the table is out of the chassis, the operator sets an opti- 
cal disk onto the table. When the optical disk is set on 
the table and the table is moved back into the chassis, 
the optical disk is loaded on the DVD player 70. 
5 [0091 ] The mechanism control section 83 controls a 
mechanical system including the motor for driving the 
disk and the optical pidoip 82 for reading a signal 
recorded on the disk. Specifically, the mechanism con- 
trol section 83 adjusts the motor speed in accordance 
10 with the position of the track indicated by the system 
control section 93. The mechanism control section 83 
also controls an actuator of the optical pickup 82 to 
move the optical pickup 82. When an accurate track is 
detected by servo control, the mechanism control sec- 
ts tion 83 instructs the optical disk to wait until a desired 
physical sector on the rotating optical disk reaches the 
position of the optical pickup 82. Then, signals are con- 
tinuously read from the desired positk>n. 
[0092] The signal processing section 84 processes 
20 the signal read from the optical pickup 82 with, for 
exarYiple, amplification, waveform shaping, binarization. 
demodulation, and error correction to convert the signal 
into a digital data stream, and then stores the resultant 
data stream in a buffer memory in the system control 
as section 93 (described below) on a logical block-by-logi- 
cal block basis. 

[0093] The AV decoder section 85 processes the dig- 
ital data, which is an input VOB, in a prescribed manner 
to convert the data into a video signal or an audio signal. 
30 Specifically, the AV decoder section 85 includes a sys- 
tem decoder 86, a video decoder 87 and an audio 
decoder 88. 

[0094] The system decoder 86 receives the digital 
data stream transferred from the buffer memory on a 
35 logical block-by-logical block basis Ci e., on a packet-by- 
packet basis) and distinguishes a stream ID and a sub 
stream ID in the header of each packet, thereby dei- 
fying the data into a moving picture data pack, an audio 
data pack and a management information pack. At this 
40 point, the moving picture data pack is output to the 
video decoder 87. Regarding the audio data pacK only 
an audio data pack having a designated stream number 
is output to the audio decoder 88 in accordance with a 
decode stream instruction command sent from the sys- 
45 tern control section 93. The management information 
pack is output to the system control section 93. The 
moving picture data pack input to the video decoder 87 
is extended by the prescribed format defined by the 
MPEG2 format and output as digital video data. Then, 
so the digital video data is converted into a video sigral of 
the NTSG format and externally output. The audio data 
input to the audio decoder 88 is decoded in the LPCM or 
AC3 format in accordance with the data type. D/A con- 
verted, and then externally output as an audio signal. 
55 [0095] The audio decoder 88 processes the digital 
data, which is an input AOB, in a prescribed manner in 
accordance virith the data type, converts the data into an 
audio signal, and externally outputs the data. 
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[0096] The system control section 93 includes a work- 
ing memory and a CPU integrated together and per- 
forms the overall control of the DVD player 70. 
[0097] The reproduction apparatus according to the 
present invention operates in, for example, the following 
manner. 

[0098] When a DVD is loaded in the DVD player 70, 
the system control section 93 detects that a DVD is 
loaded from the optical sensor or the like. Then, the sys- 
tem control section 93 controls the mechanism control 
section 83 and the signal processing section 84, 
thereby controlling rotation of the DVD so as to cause 
the optical pickup 82 to seek to the lead-in region. Thus, 
the DVD player 70 is initialized and reproduction starts. 
[0099] For starting the reproduction, the system con- 
trol section 93 determines whether or not the DVD. 
player 70 is in a video-oriented reproduction mode, by a 
reproduction mode determination section. When it is 
determined that the DVD player 70 is in the video-ori- 
ented reproduction mode, the system control section 93 
reads the video manager based on the information 
which is read from the volume file management region. 
The system control section 93 refers to the PGC man- 
agement information table for the video manager menu 
to cateulate the recording address of the PGC for the 
volume menu. The resultant PGC is reproduced and 
retained inside. When the PGC for the volume menu is 
retained inside, the system control section 93 refers to 
the retained PGC infomiation to calculate the video 
object (VOB) to be reproduced and the recording 
address of the VOB on the optical disk. When the VOB 
to be reproduced is determined, the system control sec- 
tion 93 outputs a control signal to the mechanism con- 
trol-section 83 and the signal processing section 84 so 
as :to retrieve the determined VOB from the DVD for 
reproduction. Thus, the video menu from which the user 
can select the title to be reproduced is displayed. 
[0100] The user sees the menu and selects and con- 
firms the title that hefshe is interested in by designating 
the item number in the menu using the remote control- 
ler. Then, the system control section 93 receives the 
designation of the item number in the menu from the 
remote controller and refers to the management infor- 
mation pack included in the VOB of the video menu 
which is being reproduced, the VOB being input from 
the AV decoder section 85, to execute a control com- 
mand corresponding to the designated number. The 
control command is PlayTrtle #n or the like, and the title 
number to be reproduced is designated by "n". As an 
execution operation by the PlayTrtle command, the sys- 
tem control section 93 refers to the title search pointer 
table, which is a part of the audio manager, to determine 
the audio title set (ATS) to whidi the designated title 
belongs to and the title number in the ATS. When the 
ATS is confirmed, the system control section 93 outputs 
a control signal to the mechanism control section 83 
and the signal processing section 84 so as to reproduce 
the ATS management information of the confirmed title 



set and retrieves the title search pointer table of the 
ATS. which is a part of the ATS n^nagement informa- 
tion, to the system control section 93. When the title 
search pointer tat)le is retrieved, the system control sec- 

5 tion 93 refers to the table to determine the PGC informa- 
tion for starting the reproduction of the title to be 
reproduced. When the PGC information is determined, 
the system control section 93 outputs a control signal to 
the mechanism control section 83 and the signal 

,0 processing section 84 so as to reproduce the deter- 
mined PGC information and retain the information in the 
inside buffer memory for the PGC information. When 
the PGC information is retained, the system control sec- 
tion 93 refers to the retained PGC information to deter- 

,5 mine the audio object (AOB) to be reproduced and the 
recording address thereof. Then, the AOB is repro- 
duced by a control signal output to the mechanism con- 
trol section 83 and the signal processing section 84 
from the system control sectton 93- 

20 [0101] The system control section 93 sequentially 
determines the AOBs to be reproduced and controls the 
reproduction thereof in accordance with the retained 
PGC infomiation. When the reproduction of the final 
AOB indicated by the PGC information is completed, the 

25 system control section 93 searches for the PGC infor- 
mation of the next title and reproduces the AOBs 
described in the PGC information in the same manner. 
Thus, all the titles are reproduced and the operation is 
stopped. In accordance with specific setting of the DVD 

30 player or the DVD. only one title can be reproduced 
before the operation Is stopped, or a menu can be dis- 
played after reproduction of one or more titles is com- 
pleted. 

[0102] Next, a method for reproducing a still picture 
35 cell, a silent cell and an audio cell will be descrtoed in 
detail. 

[0103] Figure 14 shows a conventional meUiod for 
reproducing the audio cell. Conventionally, for reproduc- 
ing an MPEG2 stream, tiie leading end of the audio cell 

40 pack is first sought and data reading starts. However, 
audio output does not immediately start but starts after 
an idle time period, wtiich is predetermined in each 
reproduction apparatus. The idle time period includes a 
time period required for determining tiie PTS of tiie 

45 audio data, a time period required for determining tiiat 
data is corect. and a time period required for the muting 
circuit in an analog output section to be transitioned 
from a mute state to a non-mute state. Thus, tiie idle 
time period varies in accordance with tiie type of repro- 

50 duction apparatus. Especially when the reproduction 
section and the decoder are accommodated in separate 
chassis, the idle time period tends to be extended 
because determination on the PTS and tiie determina- 
tion on the correctness of the audio data are separately 

55 performed. 

[01 04] Figures 1 2 A and 1 2B show methods for repro- 
ducing only audio data witiiout (fisplaying a still picture 
even though the still picture is included. Figure 12A 
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Shows the method in the case where the reproduction is 
performed from the leading end of the data, and Figure 
1 2B shows the method in the case where the reproduc- 
tion is performed in continuation from the previous cell. 
[0105] In the case where reproduction is performed 
from the leading end of the data by selecting a title or 
program from the menu or the like through jumping, the 
leading pack of the silent cell is jumped to with reference 
to the start address of the cell information. At this point, 
the STC, which is the reference time of the decoder is 
set with the SCR of the leading pack of the silent cell. 
Next, skipping and jumping of data corresponding to a 
prescribed idle time period are performed with refer- 
ence to the PTS of the silent cell, and the silent cell for 
the idle time period is reproduced. Audio output is pre- 
pared for during this period. At this point, the next title 
number is not displayed on the display device of the 
reproduction apparatus, and the passage of reproduc- 
tion time period is not updated. In the case where the 
audio output is started and display of the title number 
and the updating of the passage of the reproduction 
time period are performed simultaneously when the first 
PTS of the leading cell is detected, the reproduction 
apparatus behaves as if the audio data is output simul- 
taneously with the completion of the jump such as menu 
selection. In the case where the reproduction is per- 
formed in continuation from the previous cell, a still pic- 
ture pack is jumped over and a silent cell is jumped over 
or skipped except for the idle time period. At this point, 
by continuously counting the STC. which is reference for 
the system time, the interval between the completion of 
the audio output by the previous cell and the start of the 
audio output by the next cell equals the audio pause 
time period. The counting of the STC is continued when 
the physical allocation information and the time attribute 
information both have a value indicating "continue". 
When either one of them indicates "no-continue", the 
same processing as in the jump from the menu is per- 
formed, and thus the STC is reset at the leading end of 
the silent cell pack. Even in the case where there is no 
still picture cell, the method Is substantially the same as 
described atDOve. In the case where there is no silent 
cell and the reproduction starts from the leading end of 
the data, the operation is similar to the conventional 
operation shown in Figure 14. In the case where the 
reproduction is performed in continuation from the pre- 
vious cell, the operation is as follows. When the time 
attribute information indicates "continue", the audio cell 
is decoded continuously from the previous cell and 
audio data is output. When the time attritiute information 
indicates "no-continue", the operation is the same as 
the conventional operation shown in Figure 14 as in the 
case where the reproduction is performed from the 
leading end of the data. 

[01 06] Figures 1 3A and 1 3B show methods for repro- 
ducing the audio data while displaying a still picture. 
Figure 13A shows the method in the case where the 
reproductbn is performed from the leading end of the 



data, and Rgure 13B shows the method in the dase 
where the reproduction is performed in continuation 
from the previous cell. 

[0107] In the case where the reproduction is per- 
5 formed from the leading end of the data or by selecting 
a title or program from the menu or the like through 
jumping, the pack of the still picture cell is sought from 
the cell .informatwn. Thus, the still picture cell is read 
and decided. At this point, the STC, which is the refer- 
to ence time of the decoder, is set with the SCR of the 
leading pack of the still picture cell. Next, the leading 
pack of the silent ceU is read. When an STC reaches an 
STC of the still picture cell, the still picture is displayed. 
The rest of the operation is the ssune as the operation 
15 when there is no still picture. The display of the still pic- 
ture can be during the processing of the silent cell, 
simultaneously with the start of output of the audio cell, 
or after the start of output of the audio cell in the range 
permitted by the MPEG2 format. In the case where the 
20 reproduction is performed in continuation from the pre- 
vious cell, the still picture cell is read and decoded when 
a still picture pack is detected. Next, the silent cell is 
processed. Whether or not the STC is set depends on 
the time attribute information as in the case where there 
25 is no still picture cell. The rest of the operation is the 
same as the operation when no still picture is displayed, 
except that the still picture is displayed when the STC 
becomes a PTS of the still picture cell and that the STC 
Is set with the SCR of the leading pack of the still picture 
30 cell. 

[0108] Figures 15 through 18 are flowcharts each 
illustrating a program. In the case where the physical 
allocation information of the program Information shows 
"continue" and the program previously reproduced has 

35 a program number which is smaller by one than the pro- 
gram number of the program to be reproduced now, 
seek to the reading head for the DVD is not specifically 
necessary. When the time attritxjte information indi- 
cates "continue" and the reproduction is performed in 

40 continuation from the previous program, the STC, which 
is the reference time for the decoder, does not need to 
be reset 

[01 09] The determination of whether or not the cell is 
a still picture cell can be performed using the cell type in 

45 the cell information or using a still picture flag of the pro- 
gram information. The determination of whether or not 
the cell is a silent cell is perfbmied by the cell type in the 
cell information. The determination that the cell is the 
final cell is performed by comparing the termination 

so address of the cell information and the address read 
from the data in the DVD. The conrpletion of the repro- 
duction of the program can be determined by the cell 
index of the cell information returning to zero, the cell 
type indicating a still picture cell or a silent cell, or the 

55 start cell number of the next program in the program 
information. 

[0110] The skipping of the silent cell is performed 
while delecting the PTS when the silent cell is decoded 
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or by obtaining the number of packs to be skipped 
based on the data rate. 

[0111] As desalbed above, in the first example 
according to the present invention, program reproduc- 
tion infdmiation including the start time and reproduc- 
tion time period of each of audio data based on the 
reproduction start time of the leading audio data in an 
MPEG2 stream is recorded in the management region 
as a part of the reproduction control information. 
Accordingly, a multimedia information storing medium 
which realizes reproduction of high quality digital audio 
data and video data added thereto under a restricted bit 
rate can be provided. The interval between the r^ro- 
duced audio data can be uniform even in low-cost repro- 
duction apparatuses or reproduction apparatuses 
having no reproduction function for video data. Thus, 
title creators can prepare data easily. 

(Example 2) 

[01 1 2] An optical disK and an apparatus and mettiod 
for reproducing information from the optical disk in a 
second example according to the present invention will 
be described. Identical elements previously discussed 
in the first example bear identical reference numerals 
and the descriptions thereof will be omitted. 



which is backup data of the audio title set management 
infomiation 801. In the following desaiption. an "audio 
title set" will generally be referred to as an "ATS". 

5 (3.1.1) Data structure of the AOB 802 

[01 17] The data structure of the AOB 802 of the opti- 
cal disk is identical with that described in the first exam- 
ple and thus the description thereof wfll be omitted. 



10 



(3.1.2) Data structure of P.VOB 1002 



(1) Physical structure of the optical disk 

[0113] The physical structure of the optical disk is 
identical with that described in the iirst exanrf)le and 
thus the desCTlption thereof will be omitted. 

(2) logical structure of the optical disk 

[01 1 4] The logical structure of the optical disk is iden- 
tical with that described in the first example and thus the 
description thereof will be omitted. 

(3) Data structure of the audio zone region 32c 

[0115] The audio zone region 32c stores an audio 
manager 900 and one or more audio title sets 800 as In 
the first example. The data structure of the audio man- 
ager 900 and the data structure of the audio title sets 
800 are different from those.in the first example. 

(3.1) Data structure of the audio title set 800 

[01 1 6] Figure 23 shows a data structure of the audio 
title set 800 in the second example. The audio title set 
800 includes a plurality of audio objects (hereinafter, 
referred to as "AOBs") 802, a plurality of picture video 
objects (hereinafter, referred to as "P.VOBs" 1002). 
audio title set management information (ATSI) 801 for 
managing the order of reproducing the pluralrty of AOBs 
802 and the plurality of P^VOBs 1002, and audio title 
set management information backup (ATSI.BUP) 804 



[01 18] Figure 31 shows a data structure of the P_VOB 
1002. The P_VOB 1002 Includes a picture NV pack 
15 (P_NV_PCK) 1003, a plurality of video packs (V_PCK) 
1004, and a plurality of sub-picture packs (SP_PCK) 
1005. 

[01 19] Unlike in the case of DVD-Video, the P_VOB 
1002 includes one picture vWeo object unit (P_VOBU), 
20 and or^y one picture NV pack (P_NV.PCK) 1003 is 
included. 

[0120] The sub-picture packs (SP.PCIQ 1005 can 
each have a plurality of sub-picture streams and has an 
identification code as in the case of DVD-Video. The 

25 sub-picture packs (SP^PCK) 1005 can be omitted. 
[01 21 ] The P.VOB 1 002 does not include audio data, 
unlike in the case of DVD-Video. The picture NV pack 
(P_NV_PCK) 1003 includes a P_PCI packet and a 
P_DSI packet in a similar manner as a PCI packet and 

30 a P„DSI packet of DVD-Video. 

Ph22] lAs shown in Figure 41, the P_PCl indudes ' 
P_VOBU to which the P.PCI belongs to (i.e.. attrilxjte 
infomiation. reproduction time information, highlight 
infomiation and the like of P.VOB). as in the case of 

35 DVD-Video, but does not include address information. 
[01 23] As shown in Figure 42, the P^DSI includes an 
SCR of the N V^PCK to whfch the P^DSI betongs. and a 
termination address of ttie P_VOBU. i.e., P.VOB to 
which the P_DSI belongs, and address information of a 

40 pack including ttie final data of the first I picture of ttie 
video pack (P_PCK) as in ttie case of DVD-Video, but 
does not Include other information. 

(3. 1 .3) Data structure of the audio title set management 
45 infomiation 801 

[0124] The audio titte set management information 
(ATSI) 801 includes information for managing the order 
of reproducing the AOBs 802 and ttie P^VOB 1002. The 
so order of reproducing the AOBs 802 is designated by a 
program chain (PGC). as in the case of video objects 
. (VOBs). 

[0125] The data structure of the audio title set man- 
agement information 801 is identical with tiiat shown in 
55 Figure 5 except for the data structure of ttie PGC infor- 
mation 833. 

[0126] Each of ttie PGC information urwts d^cribes 
positions on ttie optical disk where one or more audio 
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Objects are recorded and the order of reproduction 
thereof. Reproduction of the same audio object can be 
described by a different PGC information unit. Specifi- 
cally, the PGC information includes "ATS PGC general 
information {ATS„PGC_GI)". "ATS program information 5 
table (ATS PGIT)", "audio cell reproduction information 
table (ATsIc.PBIT)". "ATS picture program information 
table (ATS^PPGIT)". and "ATS picture cell reproduction 
Information table (ATS^PC.PBIT)". 
[0127] Figure 25 shows a data structure of the PGC 10 
information. As shown in Figure 25, "ATS PGC general 
information (ATS_PGC_GI)" includes the number off pic- 
ture programs, the number of audio programs and the 
number of cells Included in the PGC information; the 
reproduction time period of the PGC; and infomnation is 
on pointers to a picture program reproduction mode, 
picture program reproduction control, the "ATS program 
information table (ATS^PGIT)". "audio cell reproduction 
Information table (ATS^C^PBIT)", "ATS picture program 
infbmiation table (ATS^PPGIT)". and "ATS picture cell 20 
reproduction information table (ATS_PC_PBIT)". 
[0128] The "ATS program information table 
(ATS^PGIT)" includes a plurality "audio program infor- 
mation (ATS.PGI)" units included in the PGC. Each of 
the plurality of "audio program information (ATS_PGI)" 2S 
units includes "audio program physical allocation info- 
ramtion" indicating whether or not the AOB of each pro- 
gram and the AOB of the previous program are 
recorded at physically discontinuous positions on the 
optical disk, "audio program time attribute information" 
indicating whether or not the time information of the 
AOB is continuous with the time information of the pre- 
vious AOB, "audio program start cell number" indicating 
the first cell number tornttng the audio program, "repro- 
duction start audto cell time" indicating the first tirne 
information of the first audio cell included in the audio 
program, "audio program total reproduction time period" 
indicating the reproduction time period of the audio pro- 
gram, and "audio pause time period" indicating the 
silent period until the r^roduction of tiie audio cell of 
the audio program starts. 

[0129] The "audio cell reproduction information table 
(ATS_C_PBIT)" stores cell information forming the AOB 
to be reproduced as in tiie first example. 
[0130] The "ATS picture program information table 
(ATS_PPGIT)" includes a plurality of "ATS picture pro- 
gram information" units. Each ATS picture program 
information unit includes a used SP number 
(PPQ^SP^STN) describing a sti-eam number of a sub- 
picture used in tiie picture program, an initial button 
number (PPG_FOSL) indicating tiie number of a button 
which is in the highlight information used in ttie picture 
program and is selected in an initial state, a picture tran- 
sition mode (PPG.T_mode) indicating a transition 
mode of a still picture in the program, a still picture iden- 
tffication code (PPG_ISRC_SPCT) indicating an ISRC 
code of tiie still picture in the program, a picture cell 
start PTS (PC_S_PTM) indicating a PTS of a first pack 



of ttie picture cell of the program, a picture program 
reproduction time period (ATS_PPG_PB_TM) which is 
a reproduction time period of tiie program, a start sec- 
tion transition time period (PPG.TLTM) indicating ttie 
transition time period at the time of starting the repro- 
duction of the still picture of tiie program, and a termina- 
tion section transition time period indicating tiie 
transitiori time period at the time of terninating r^ro- 
duction of tiie still picture off the program. 
[0131] In tills example, as the picture transition 
modes, "no transition", "fading from black", "fading into 
black", "cross-fading", and "wiping in several directions" 
are assumed. Each of ttie programs includes one cell. 
Since each cell has an independent P.VOB, ttie repro- 
duction time period of ttie picture program is a 1 -frame 
time period. 

[0132] The "ATS picture cell repiroduction Information 
table (ATS_PC_PBIT)" includes a cell still time period 
(P_C_StilLTime) indicating a continuous time period 
during which the picture cell is displayed, a start 
address (P_C_FVOBU_SA) of a cell of the picture pro- 
gram, and a termination address (P_C_LVOBU_SA) 
indicating an address of the final packet of the cell. 
[0133] Figure 24 shows an exemplary structure off the 
AOB. The AOB is a part of an MPEG2 stream and 
includes a silent cell including an audio pack including 
substantially silent audto data and an audio cell Includ- 
ing an audio pack of audio data forming a tune. The 
AOB includes one or more audio cells and may not 
30 include a silent cell. A silent cell is never followed by 
anottier silent cell and is always followed by an audio 
cell. In ttie exanrple shown in Figure 24, audio cells and 
silent cells exist and are physically continuous. Time 
information is also continuous: i.e., the "audto program 
35 physical altocation information" has a value represent- 
ing "continue", and the "audio program time attribute 
infomiation" also has a value represeiiting "continue". 
[01 34] In Figure 24, ttie line passing ttirough points B, 
C, E, F and G represents a change in the value of the 
40 time information (i.e. PTS) of the AOB. Point B repre- 
sents a value off ttie first PTS of a silent cell. Point C rep- 
resents a value off ttie first PTS of an audto cell. Thus, 
the PTS of a silent cell is continuous to the PTS of an 
audio cell, and there is no data underflow gap. as 
45 referred to with respect to ttie MPEG2 stiream. between 
the silent cell and ttie audio cell. In a similar manner, ttie 
PTS of ttie next silent cell is represented by point E. The 
difference between the first PTS of tiie next audio cell at 
point F and tiie final PTS of ttie audio cell at point D is 
so an "audio pause time period". Since the PTS's need to 
be continuous in one stiream as specified by MPEG2. 
the change in the PTS is linear as shown in Figure 24. 
[0135] With reference to Figures 31, 41 and 42, ttie 
picture video object (P_VOB) will be described in detail. 
ss As described atxjve. the leading pack of the P_VOB 
1002 is a picture NV pack (P^NV.PCK) 1003 including 
a P_PCT packet and a P_DSI packet having time infor- 
mation, position information and highlight information. 



14 



<EP pG42609A1_L> 



27 



EP 0 942 609 A1 



28 



Only one picture NV pack (P^NV^PCK) 1003 always 
exists at the leading end thereof. The picture NV pack 
(P_NV_PCK) 1003 is followed by video packs (V_PCK) 
1004 which are MPEG2 video packs for storing video 
data and subi^icture packs (SP.PCK) 1005 for dividing 5 
sub-picture streams which are permitted to be included 
up to 32 streams and storing the divided sub-picture 
streams. In Figure 31, 2 sub-picture streams 1005 
(SP#1 and SP#2) are included and each sub-picture 
stream is divided into 2 packs. In Figure 31, the video 10 
packs (V_PCK) 1004 precede the sub-picture packs 
(SP_PCK) 1005, but there is no limitation regarding the 
Older as long as the MPEG2 standards are fulfilled. 
Although termination codes such as program encodes 
or the like are not shown in Figure 31 , such termination is 
codes can be included as long as the requirements of 
MPEG2 streams are fulfilled. Such termination codes 
need not be included since the P.VOB 1 002 is a part of 
the MPEG2 program stream. 

(01 36] Figure 41 shows a structure of the P_PCI infor- so 
mation included in the P^PCI packet. The P_PCI infor- 
mation includes P_PCI general information. P^PCI 
highlight information, and P_PCI recording information. 
The P_PCI general information includes a P_VOBU 
type (P_VOBU_CAT) describing the type of the analog 25 
copy protection with respect to the P_VOBU video data. 
P_VOBU start time (P.VOBU_S_PTM) describing the 
PTS of the first video to be displayed included in the 
P VOBU, P_VOBU termination time 
(p1vOBU_E_PTM) describing the PTS of the final 30 
video to be displayed included in th6 P.VOBU 
P^VOBU.SEQ time (P.VOBU.SEQ^E.PTM) describ- 
ing the PTS including the SEQ existing in the P_VOBU. 
and P_VOBU cell reproduction time 
(P__VOBU_C_ELTM) indicating relative time in a picture 35 
cell of the first video to be displayed of the P.VOBU. 
The P_VOB is always an I picture of 1 VOBU. 1 cell and 
1 video frame, and always includes SEQ. Accordingly, 
the P_VOBU.S.PTM. P_VOBU_E_PTM. 

P_VOBU_SE_E_PTI\/l have an identical value, and the 40 
P_VOBU_E_ELTM indicates 0. 

[0137] The P_PCI highlight information includes 
P^PCI highlight general information (P_PCLHL_GI) 
describing the start time, termination time, number of 
buttons, the initial selection button number, forcible exe- 45 
cution button number and the like of the highlight infor- 
mation; a P_PCI button color information table 
(P_BTN_COLlT) describing button color information; 
and a P_PCI button information table (P_BTNIT) 
describing the coordinate, magnitude, operation mode so 
and the like of the button. Since the P.VOBU includes 
one video frame as described above, the P_PCLHL_GI 
is described so that the start time of the highlight infor- 
mation indicates 0 and the termination time indicates 

55 

infinity. 

[0138] The P_PCI recording information includes a 
P_PCI video ISRC code (PJSRC_V) describing an 
ISRC code of the video of the P.VOBU; and a P_PCI 



sub-picture ISRC code (PJSRC^SP) describing an 
ISRC code of the sub-picture of the P.VOBU. 
[01 39] Figure 42 shows a structure of the P„DSI infor- 
mation desaibed in the P^DSI packet. "The P^DSI 
includes only the P.DSI general information 
(P DSLGI). The P_DSI general information includes 
P_VOBU„NV pack time (P^NV.PCK.SCR) coae- 
sponding to the least significant 32 bits of the SCR of 
the NV pack of the P_VdBU. a P^VOBU termination 
address desaibing the relative address with respect to 
the NV pack of the final pack of the P.VOBU. and a 
P_VOBU first reference address 

(P_VOBU_lSTREF_EA) desCTibing the relative 
address with respect to the NV pack of the pack Includ- 
ing the final data of the first I picture of the video of the 
PJ/OBU. Since the P_VOBU includes 1 VOBU, the 
P_NV_PCK_SCR is always 0. 

[0140] Figure 29 shows the relationship among the 
PGC, audio program, cell, picture program, picture cell, 
AOB. and P_VOB. The entirety of Figure 29 represents 
one PGC. A plurality of such PGCs are included in one 
ATS. As described above, a PGC includes audio pro- 
grams describing the reproduction order by the audio 
data access unit and picture programs describing the 
reproduction order by the video data access unrt. Each 
audio program has a cell, which is the minimum man- 
agement unit. The cell poffite to an AOB which is actual 
audio data and thus determines the reproduction data. 
In a similar manner, each picture program has a picture 
cell, which points to a P_VOB. which is actual video 
data, and determines the contents to be reproduced. 
[0141] Due to such a structure, actual reproduction 
data pieces can be recorded on the disk in a different 
order. Alternatively, the same data piece can be pointed 
by a plurality of cells or picture cells. In order to guaran- 
tee the reproduction continuity, the audio data pieces 
has a flag which indicates whether the physical layout of 
the data on the disk is continuous or the data is a con- 
tinuous part of one AOB (i.e., audio program physical 
allocation information, audio program time attribute 
information). The video data is fundamentally a still pic- 
ture. Accordingly, one video data program includes one 
cell, and one cell includes one P^VOB. The physical 
an-angement of the P_VOBs causes no specific prob- 
lems. Thus, the vWeo data does not have such a flag. 
[01 42] Figure 30 shows an exemplary PGC forming a 
title. The example showvn in Figure 30 includes five pro- 
grams. Programs #1 and #2 correspond to AOB #1 . and 
programs #3. #4 and #5 correspond to AOB #2. On the 
recording medium. AOB #1 is recorded after AOB #2. 
Programs #1 and #2 both include a silent cell and a 
silent cell, and program #2 includes two audfo cells. Pro- 
grams #3 and #4 include a silent cell, and program #5 
includes only an audio cell. 

[0143] In the case where all the audio cells each have 
a reproduction time period of 60 seconds (5.400.000 in 
PTS) and all the still picture cells each have a reproduc- 
tion time period of 1 second (90.000 in PTS). audfo pro- 
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gram information can be described as shown in Figure 
32. Picture program information can be described as 
shown in Figure 33. Under the conditions that the audio 
data is 48 kHz. 16 bit sampling with 2 channels, the 
number of the silent packs is 96 and the nunrtber of the 
avxiio cell packs Is 5760 as showvn in Figure 34. Where 
the number of still picture packs is 50, the picture cell 
information is as shown in Figure 35. In such a case, it 
is assumed that the P_VOB used in the picture cell is 
recorded at a position following an AOB. The recording 
positions for the P.VOB and AOB are not physically lim- 
ited, and the P^VOB and AOB can be positioned in a 
mixed state with no specific problem. In such a case, the 
physical allocation of the audio program Information of 
no-Continue indicates that the AOB indicated by the 
audio program is not continuously reproducible. The 
audto cell and the picture cell both share the AOBs and 
P_VOBs used by the other cells. 
[0144] The audio title set has been described. Next, 
with reference to Figure 22, the audio manager will be 
described. 

(3.2) Data structure of the audio manager 900 

[0145] The audio manager 900 is infornr\ation for con- 
trolling the reproduction which is to be first referred to for 
performing audio-oriented reproduction of the informa- 
tion on the optical disk by a reproduction apparatus. 
[01461 Rgure 22 shows a data structure of the audio 
manager 900. 

[0147] The audio manager 900 includes "audio man- 
ager information (AMGI)", "VOB for audio manager 
menu {AMGM_VOBS)". and "audio manager informa- 
tion backup (AMGLBUP)" as in the first example. 
[0148] The "audio manager information (AMGI)" 
includes "audio manager information management 
table (AMGLMAT)" including attribute information and 
pointer information, "audio title management informa- 
tion" indicating the number of audio titles and the like, 
"audio title search poirter (ATT.SRP)" indicating search 
information on the audio titles, and "audio manager 
menu PQC management information table 
(AMQM^PQCLUT)" indicating PQC information for 
audio manager menu, as in the first example. 
[0149] The "audio manager information management 
table (AMGLMAT)" includes an AMG identifier 
(AMG_ID) for identifying an audio manager, an AMG 
termination address (AMG_EA) which is a termination 
address for table management, an AMGI termination 
addr^s (AMGLEA). an AMGLMAT termination 
address (AMGLMAT_EA), address information on the 
AMG and AMGI tables, version number (VERN). a vol- 
ume set identifier (VLMS_ID), a number of title sets 
(TS_Ns) indicating the number of the title sets included 
in the volume, a provider identifier (PRV_ID) for identify- 
ing the provider which produced the disk, an autorratic 
execution flag (Auto_Play_Flag) defining the operation 
of the player when the disk is inserted, and 



AMGM^VOBS indicating VOB atlrfoute information 
existing in the audio manager. 
[0150] The "audio titie search pointer table 
(ATT_SRP)" has an identical structure with tiiat in the 

5 first example. 

[0151] The audio zone region and tiie DVD as a mul- 
timedia optical disk have been described. Next, a repro- 
duction apparatus, according to tiie present invention, 
for reproducing a media having the above-described 

10 structure will be described. 

[0152] The t>asic structure of the reproduction appa- 
ratus is similar to the structure described in the first 
example. In the second example, a key for separately 
controlling audio data and video data is provided in a 

IS remote controller for operating the DVD player or a front 
panel of the DVD player. Wrth such a key. tiie video data 
can be skipped forward and backward or rewound to tiie 
start of tiie video data while continuously reproducing 
the audio data. 

20 [0153] Figure 26 is a block diagram illustrating an 
internal structure of a DVD player 80 in tiie second 
example. The DVD player 80 is different from tiie DVD 
player 70 shown in Figure 8 in the structure of the AV 
decoder section, which will be described below. 
25 [01 54] In tiie second example, tiiere are two streams, 
which are an AOB as audio data and P_VOB as video 
data. An AV decoder section 85a includes two decoders 
respectively corresponding to the AOB and P_VOB. 
These decoders are operated synchronously witti or 
30 asynchronously from each otiier. Specifically, the AV 
decoder seclton 85a includes a P_VOB system decoder 
103 for receiving a P.VOB stream and distinguishing a 
stream ID and sub-stream ID in a header of each packet 
included in the stream, tiiereby classifying tiie cteta into 
35 a video packet, a PCI packet, and a sub-picture packet. 
The AV decoder section 85a further includes an AOB 
system decoder 104 for receiving an AOB stream and 
classifying tiie data on a packet header-by-packet 
header basis. The AV decoder section 85a still further 
40 includes a highlight Ixiffer 94 for temporarily storing 
highlight information of a PCI packet from the P_VOB 
system decoder 103, a vkJeo buffer 96 for temporarily 
storing a video packet in a similar manner, a sub-picture 
buffer 105 for temporarily storing a sub-picture packet. 
45 an audio buffer 99 for temporarily storing an audio 
packet from the AOB system decoder 104, a highlight 
decoder 95 for decoding the highligfit infbrmation from 
the highlight buffer 94 and outputting the decoded high- 
light information to tiie system control section 93, a 
so video decoder 87 for decoding the video data from tiie 
video buffer 96, a suk>-picture decoder 98 for decoding 
tiie sub-picture data from tiie sub-picture buffer 1 05, an 
audio decoder 1 00 for decoding the audio data from tiie 
audio buffer 99 and outputting tiie decoded audio data 
55 as an audio output, a \n6&) synthesizer 101 for synthe- 
sizing tiie decoding results of tiie vWeo decoder 87 and 
ttie sub-picture decoder 98 into one piece of video data, 
and a synchronization adjusting section 1 02 for manag- 
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ing the synchronization of the highlight decoder 95, the 
video decoder 87, the sub-picture decoder 98 and the 
audio decoder 100. 

[01551 The reproduction apparatus according to the 
present invention operates In, for exannple, the following 
manner. The operation up to the reading of the stream 
is the same as descrtoed in the first example and will not 
be described below. 

[0156] For starting the reproduction, the system con- 
trol section 93 deterntines whether or not the DVD 
player 80 Is in a video-oriented reproduction mode, by a 
reproduction mode determination section. When It Is 
determined that the DVD player 80 is in the video-ori- 
ented reproduction mode, the system control section 93 
reads the video manager based on the information 
which is read from the volume file management region. 
The system control section 93 refers to the PGC man- 
agement information table for the video manager menu 
to calculate the recoiding address of the PGC for the 
volume rhenu. The resultant PGC is reproduced and 
retained inside. When the PGC for the volume menu is 
retained inside, the system control section 93 refers to 
the retained PGC information to calculate the video 
object (VOB) to be reproduced and the recording 
address of the VOB on the optical disk. When the VOB 
to be reproduced is determined, the system control sec- 
tion 93 outputs a control signal to the mechanism con- 
trol section 83 and the signal processing section 84 so 
as to retrieve the determined VOB from the optical disk 
for reproduction. Thus, the video menu from which the 
user cart S6l6ct the title to be reproduced is displayed 
(see Figure 40). 

[0157] The user sees the menu and selects and con- 
firms the title/that he/she is interested in by designating 
the item nunriber In the menu using the remote control- 
ler. Then, the system control section 93 receives the 
designation of the item number in the menu from the 
remote controller and refers to the management infor- 
matton pack included in the VOB of the video menu 
which Is being reproduced, the VOB being input from 
the AV decoder section 85a, to execute a control com- 
mand corresponding to the designated numtjer. The 
control command is PlayTitle #n or the like, and the title 
nunt>er to be reproduced is designated by "n". As an 
execution operation by the PlayTitle command, the sys- 
tem control section 93 refers to the title search pointer 
table, which is a part of the audio manager, to determine 
the audio title set (ATS) to which the designated title 
belongs to and the title number in the ATS. When the 
ATS is confirmed, the system control section 93 outputs 
a control signal to the mechanism control section 83 
and the signal processing section 84 so as to reproduce 
the ATS management information of the confirmed title 
set and retrieves the title search pointer table of the 
ATS. which is a part of the ATS management Infonma- 
tion, to the system control section 93. When the title 
search pointer table is retrieved, the system corrtrol sec- 
tion 93 refers to the table to d^ermine the PGC Infomia- 



tion for starting the reprodudiOT of the title to be 
reproduced. When the PGC information Is determined, 
the system control section 93 outputs a control signal to 
the mechanism control section 83 and the signal 

5 processing section 84 so as to reproduce the deter- 
mined PGC information and retain the information in the 
inside buffer memory for the PGC information. When 
the PGC information is retained, the system control sec- 
tion 93 first refers to the ATS picture program infbrma- 

70 tion table, with reference to the retained PGC 
infonnation. to read all the P_VOBs described in the 
PGC information and irqjuts the P_VOBs to the AV 
decoder section 85a. The AV decoder section 85a sep- 
arates the input P_VOBs on a pack-by-pack basis or 

,5 packet-byiDacket basis by the P_VOB system decoder 
103 and stores the P_VOBs in corresponding buffer 
memories. 

[01 58] At this point, the highlight decoder 95, the video 
decoder 87, and the sub-picture decoder 98 do not per- 

20 form decoding operations. When all the P_VOBs are 
stored in the corresponding buffer memories, the AOB 
to be reproduced and the recording address thereof are 
determined by the ATS program information table and 
the ATS cell reproduction information table. Then, the 

25 AOB is reproduced by a control signal output to the 
mechanism control section 83 and the signal process- 
ing section 84 from the system control section 93. At 
this point, the highlight decoder 95, the video decoder 
87, and the sub-picture decoder 98 perform decoding 

30 operations for the f irst time to start video output, high- 
fight processing and audio ou?)ut. The ou^jiit timing is 
adjusting l>y the synchronization adjusting section 102 
in accordance with the audio program information, pic- 
tore program information, highlight information and time 

35 code information (PTS) of each packet. 

[0159] In the second example, data for the con-e- 
sponding picture programs is all stored in the conre- 
sponding buffers before the audio data Is reproduced. 
Accordingly, the highlight buffer 94, the video buffer 96, 

40 and the sub-picture buffer 105 in the DVD player 80 in 
the second example require a larger buffer memory 
capacity than the capacity specified by MPEG2 or DVD- 
Video. 

[0160] Thereafter, the system control section 93 
45 sequentially determines the AOBs to be reproduced 
and controls the reproduction thereof in accordance 
with the retained PGC information, and also decodes 
the highlight information, sub-pictore infornnation and 
video information which are already read in the buffer 
so memories. When the reproduction of the final AOB ir\di- 
cated l>y the PGC information is completed, the system 
control section 93 searches for the PGC information of 
the next title and reproduces the P.VOBs and the AOBs 
described in the PGC information in the same manner. 
55 [01 61 1 Thus, the all the titles are reproduced and the 
operation is stopped. In accordance with specific setting 
of the DVD player or the DVD, only one title can be 
reproduced before the operation is stopped, or a menu 
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can be displayed after reproduction of one or more titles 
is completed. 

[0162] Next, a method for reproducing a still picture 
cell, a silent cell and an audio cell will be described in 

[0163] Figure 14 shows a conventional method tor 
reproducing the audio cell. Ck)nventionally. for reproduc- 
ing an MPEG2 stream, the leading end of the audio cell 
pack is first sought by the optical head and data reading 
starts. However, audio output does not immediately io 
start but starts after an idle time period, which is prede- 
termined in each reproduction apparatus. The Idle time 
period includes a time period required for determining 
the PTS of the audio data, a time period required for 
determining that data is correct, and a time period is 
required for the muting circuit in an analog output sec- 
tion is to be transitioned from a mute state to a non- 
mute state. Thus, the idle time period varies in accord- 
ance with the type of reproduction apparatus. Especially 
when the reproduction section and the decoder are so 
accommodated in separate chassis, the idle time period 
tends to be extended because determination on the 
PTS and the determination on the con^ectness of the 
audio data are separately performed. 
[01 64] Figures 36 A and 36B show methods for repro- 2$ 
ducing a silent cell and an audfo cell. Figure 36 A shows 
the method in the case where the reproduction is per- 
formed from the leading end of the data, and Rgure 36B 
shows the method in the case where the reproduction is 
performed in continuation from the previous cell. so 
[0165] In the case where reproduction is performed 
from the leading end of the data by selecting a title or 
program from the menu or the like through jumping, the 
leading pack of the silent cell is jumped to with reference 
to the start address of the cell information. At this point, ss 
the STC. which is the reference time of the decoder, is 
set with the SCR of the leading pack of the silent cell. 
Next, skipping and jumping of data corresponding to a 
prescribed idle time period are performed with refer- 
ence to the PTS of the silent cell, and the silent cell for 40 
the idle time period is reproduced. Audio output is pre- 
pared for during this period. At this point, the next title 
number is not displayed on the display device of the 
reproduction apparatus, and the passage of reproduc- 
tion time period is not updated. In the case where the 4S 
audio output is started and display of the title number 
and the updating of the passage of the reproduction 
time period are performed simultaneously when the first 
PTS of the leading cell is detected, the reproduction 
apparatus behaves as if the audio data is output simul- so 
taneously with the completion of the jump such as menu 
selection. 

[0166] In the case where the reproduction is per- 
formed in continuation from the previous cell, a silent 
cell is jumped over or skipped except for the idle time ss 
period. At this point, by continuously counting the STC, 
which is reference for the system time, the interval 
between the completion of the audio output by the pre- 



vious cell and the start of the audio output by the next 
cell equals the audio pause time period. The counting of 
the STC is continued when the physical allocation infor- 
mation and the time attribute infbrmatidn both have a 
value indicating "continue". When either one of them 
indicates "no-continue", the same processing as in the 
jump from the menu is performed, and thus the STC is 
reset at the leading end of the silent cell pack. In the 
case where there is no silent cell and the reproduction 
starts from the leading end of the data, the operation is 
similar to the conventional operation shown in Figure 
14. In the case where the reproduction is performed in 
continuation from the previous cell, the operation is as 
foltows. When the lime attribute information indicates 
"continue", the audio cell is decoded continuously from 
the previous cell and audio data is output. When the 
time attribute information indicates "no-continue", the 
operation is the same as the conventional operation 
shown in Figure 14 as In the case where the reproduc- 
tion is performed from the leading end of the data. 
[0167] Figures 37 through 39 are flowcharts each 
illustrating a program. Since infbmiation on the P_VOBs 
is read in the conesponding buffer memories, reproduc- 
tion of the audio data and processing of the hIgWight 
information can be performed asynchronously from 
each other, and the still picture and the sub-picture can 
be output asynchronously from each other. Needless to 
say. synchronous display is possible based on the time 
code or the time information of the system. 
[01 68] Regarding reproduction of audio information, in 
the case where the physical allocation information of the 
audio program informatfon shows "continue" and the 
program previously reproduced has a program number 
which is smaller by one than the program number of the 
program to be reproduced now- seek to the reading 
head for the DVD is not specifically necessary. When 
the time attribute information indicates "continue" and 
the reproduction is performed in continuation from Itie 
previous program, the STC. which is the reference tinte 
for the decoder, does not need to be reset. 
[0169] The determination of whether or not the cell is 
a silent cell is performed using the cell type in the cell 
information. The determination that the cell Is the final 
cell is performed by comparing the termination address 
of the cell information and the address read from the 
data in the DVD. The completion of the reproduction of 
Ihe audio program can be determined by the cell index 
of the cell information returning to zero, the cell type 
indicating a still picture cell or a silent cell, or the start 
cell number of the next program in the audio program 
information. 

[0170] The skipping of the silent cell is performed 
while detecting the PTS when the silent cell is decoded 
or by obtaining the number of packs to be skipped 
based on the data rate. 

[01 71 1 Since data of a still picture is already stored in 
the buffer memory, the display of the still picture is man- 
aged based on the position in the buffer memory at 
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which the still picture of the designated cell of the desig- 
nated program is recorded or based on the ordinal 
number (i.e.. first second, etc.) of the still picture with 
respect to the start. When the management is per- 
formed based on the position in the buffer memory, the 5 
data is sent to the video decoder 87 from the designated 
address in the video buffer 96 and displayed. When the 
management Is performed based on the ordinal number 
of the still picture, the data stored in the video buffer 96 
from the leading end thereof is sent to the video w 
decoder 87 and the display is switched when the desig- 
nated ordinal number is reached. The transmission of 
the data is stopped at this point. The display time period 
of the still picture is in accordance with the description in 
the picture cell still time {P_C.StilLTime). Since still pic- 
tures are each 1 -frame data, the present still picture is 
switched into the next still picture when the time period 
described in the picture cell still time has passed. Such 
control is usually perfomied by the system control sec- 
tion 93. A picture cell still time of FFh indicates infinity, 
which means that the still picture is switched t>asically 
only by a command, user operations, or completion of 
the audio program. When the still picture is switched, 
display effects can be added by designating the transi- 
tion iTKXle. The time to switch tiie still picture can be 
designated on a program-by-program basis before and 
after the display of tiie still picture. However, in the case 
where the reproduction apparatus does not have a spe- 
cial effect display function, tine still picture can simply be 
switched witii the display effects being ignored. 
[01721 In a syrtChrOrtOuS iridd6. the audio data is 
reproduced based on tiie audio program reproduction 
time period and tiie time code infonnation of the audio 
data, and tiie still picture and ttie sub-picture are repro- 
duced based on the picture program reproduction time 
period. The synchronisation adjusting section 102 com- 
pares the reference time information of the system and 
the reproduction time periods and tiius performs syn- 
chronization control. 

[0173] In an asynchronous nrxxJe. audio data is not 
synchronized witti and reproduced separately from 
highlight data, sub-picfture data and still picture data. 
The highlight data, sub-picture data and still picture data 
are synchronized to one anottier. and the audio data is 
continuously reproduced realtime based on the time 
information of ttie system. The still picture is switched in 
the asynchronous mode by ttie user operations and the 
command. The user operations basically include an 
operation of continuously reproducing audio programs 
while feeding picture progranrs fbnward. backward or to 
the leading end; and an operation of feeding both audio 
programs and picture programs simultaneously fbnward. 
backward or to the leading end. The command has sim- 
ilar functions. 

[0174] The synchronous mode and the asynchronous ss 
mode are switched over in accordance with the picture 
program r^roduction control. In the case where the pic- 
ture program reproduction control is designated so as to 



prohibit control by the user operations, the data is basi- 
cally reproduced in tiie synchronous mode except for by 
the command. 

[0175] In the case where the picture program repro- 
duction mode prevents the user operations and com- 
mand from synchronizing audio programs and picture 
programs witii each ottier. tiie DVD player can wait until 
the synchronisation is obtained or tiie picture programs 
can be continuously reproduced in accordance with the 
picture program reproduction time period wittiout syn- 
chronization. In the case where ttie reproduction of tiie 
audio programs is not completed when the reproduction 
of the picture programs is completed, the picture pro- 
grams can be continuously rqaroduced from the first 
picture program or the final picture program can be con- 
tinuously reproduced. In tiie case where the reproduc- 
tion of all the picture programs are completed before all 
tiie audio programs are completed, only the picture pro- 
grams can be reproduced with the audio part being 
silent, the audio programs can be reproduced from the 
first audio programs, or ttie reproduction of the audio 
title can be terminatod. Some of ttie aurfio programs 
and the picture programs included in the audio titie can 
be randomly selected and repeated a designated 
number of times. Such audio and picture programs can 
be repeated so tiiat no same program is repeated (shuf- 
fle mode). The audio programs and ttie picture pro- 
grams are synchronized to each ottier so tiiat ttie audio 
program and the picture program having the same 
30 nunt>er can be always reproduced simultaneously, or 
the audio progi-ams and the picture programs can be 
reproduced independentiy and asynchronously. 
[0176] An audio titie number or time can be directiy 
designated for reproduction by user operations, i.e., 
35 usually by a remote controller or ottier keys. Such repro- 
duction by direct designation by user operations cannot 
be used when ttie directiy designated reproduction pro- 
hibition flag (UOP1) and the time designated reproduc- 
tion prohibition flag (UOP2) of ttie ATT^CAT indicate 
40 prohibition. By such a designation, tiie titie creators can 
describe reproducible audio tities by a command under 
some conditions of the reproduction apparatus. For 
example, an audio titie which is not usually reproducible 
can be reproduced under certain conditions. For exam- 
45 pie. a certain parameter can be set in a specific players 
so that the parameter can be evaluated by a command, 
and the command can be desaibed so as to reproduce 
the audio titie only when a value is set in the parameter. 
When UOP1 and UOP2 are set so as to prohibit directiy 
50 designated reproduction, the audio titie can be repro- 
duced only by tfie specific player. Such a system easily 
allows reproduction of certain audio tities. recorded on a 
disk including a plurality of audio tities. for which fee has 
t>een paid. 

[0177] AV decoder sections having ottier sti-uctures 
are usable. For exanple, as shown In Figure 27. an AV 
decoder section 85b also acts as a system decoder for 
AOB and P_VOB. Since ttie AOB and P.VOB are input 
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at different timing, the same type of AV decoder section 
as used by DVD-Video is usable except that the capac- 
ities of the highlight buffer 94, the video buffer 96, and 
the sub-picture buffer 105 are increased and that a still 
picture management mechanism is added to the control 
of the video buffer 96. The operation of the AV decoder 
section 85b is substantially the same as that of the AV 
decoder section 85a. 

[0178] The DVD player can have the structure shown 
in Figure 28. In this structure, a P.VOB buffer 106 for 
P__VOB streams is provided immediately before the AV 
decoder section 85b. The same type of AV decoder 
section as used by DVD-Video is usaWe. All the P_VOB 
data to be read before the reproduction of the audio 
data is stored in tiie P_VOB buffer 106. The P.VOB 
buffer 106 dynamically multiplexes the P_VOBs corre- 
sponding to the reproduction order with the audio 
stream and sends ttie resultant data to the AV decoder 
section 85b. Accordingly, the system decoder 120 for 
AOB and P_VOB in the AV decoder section 85b is 
required to have a processing speed which is slightiy 
higher than the speed specified by the DVD-Video 
standaids. Streams need to be supplied to the AV 
decoder section 85b so tiiat the audio buffer 99 does 
not underflow. 

[0179] In the second example, as described above, 
program reproduction information including the start 
time and reproduction time period of each piece of 
audio data based on tiie reproduction start time of the 
leading audio data in the MPEG2 stream is recorded in 
the management region as a part of tiie reproduction 
control information. Accordingly, an optical disk for real- 
izing reproduction of high quality digital audio data 
along with tiie video data in a restricted range of bit 
rates is provided. Moreover, a certain inten/al between 
audio reproductions can be maintained even in an inex- 
pensive reproduction apparatus including no video data 
reproduction function. This allows titie creators to create 
data easily. 

[0180] Since a plurality of still pictures, sub-picture 
and menu can be displayed synchronously witii or asyn- 
chronously from Ngh quality audio data, a wider variety 
of displays become available. 

(Example 3) 

[0181] An optical disk, and an apparatus and metiiod 
for reproducing information from the optical disk in a 
third example according to tiie present invention will be 
described, identical elements previously discussed in 
the first example bear identical reference numerals aruj 
the descriptions thereof will be omitted. 

(1) Physical structure of tiie optical diisk 

[0182] The physical structure of the optical disk is 
identical with tiiat described in the first and second 
examples and thus the description thereof will be omit- 



ted. 



(2) Logical structure of tiie optical disk 

[01 83] The logical structure of the optical disk is iden- 
tical with that described in the first and second exam- 
ples and thus the description thereof will be omitted. 

(3) Data structure of the audio zone regfon 32c 



70 



[0184] Figure 43 shows a data structure of the audio 
zone region 32c. The audb zone region 32c stores an 
audio manager 900 and one or more audio titie sets 800 
as in the first and second exannples. The audio zone 
15 region 32c further stores an audio still video set 11 00. 

(3.1) Data structure of the audio manager 900 

[0185] Figure 44 shows a data structure of the audio 
20 memager 900 in tiie third example. The sb'ucture of the 
audio manager 900 has the same structure as tiiat 
shown in Rgure 4 down to the stage of tiie audio man- 
ager information management table (AMGLMAT) 902. 
[0186] The audio manager informatton management 
25 table 902 includes an ASVS start address (ASVS^SA) 
904 for storing the position of the audio still video set. 
[01 87] The structure of the audio manager information 
management table 902 is the same as tiiat shown in 
Figure 22 except for the ASVS start address 904. 

30 

(3.2) Data structure of tiie audio still video set 1100 

[0188] Figure 45 shows a data structure of the audio 
still video set 1100. The audio still video set 1100 

35 includes a plurality of picture video objects (hereinafter, 
referred to as "P_VOBs") 1102, audio still video set 
management information (ASVSI) 1101 for managing 
the plurality of P_VOBs 1102, and audio still video set 
management information backup (ASVSLBUP) 1103. 

40 In tiie following description, the audio still video set will 
generally be referred to as an "ASVS". The P_VOBs 
1 102 will generally be referred to as an "audio still video 
ot3ject(ASVOB)". 

45 (3.2.1) Data structure of tiie P^VOB 1102 

[01 89] Figure 46 shows a data structure of tiie P_VOB 
1102. The P_VOB 1102 includes a picture NV pack 
(P-NV_PCK) 1113, a plurality of video packs (V_PCK) 
50 1114, and a plurality of sub-picture packs (SP_PCK) 
1115. Only one picture NV pack 1113 is included in 
each P_VOB 1102. 

[0190] The video packs (V_PCK) 1114 each stores 
video data forming an MPEG-system I picture. Unlike 
55 the VOB. the P_VOB is for storing a still picture but not 
a moving picture. Accordingly, the video data stored in 
each video pack 1114 includes only an I picture which is 
in-frBme-corr^ressed. Herein, information indtoating 
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one still picture corresponds to one I picture. 
[01 91 ] The sub-picture packs 1 1 15 can each store a 
plurality of sub-picture streams. Each sub-picture packs 
1115 stores an identification code for identifying the plu- 
rality of sub-picture streams. The subiDicture packs 
1115 need not be Included in the P.VOB 1 1 02. 
[0192] The picture NV pack 1113 includes a DSI 
packet (not shown) and a PCI packet (not shown). The 
DSI packet stores information used for special effects 
such as fast-forward reproduction. The PCI packet 
stores highlight Information 1 120 (Figure 47). 
[0193] As shown in Figure 47, the highlight infonma- 
tion 1120 includes ASV highlight general information 
1121 indicating an effective period, the number of but- 
tons, and the like of highlight; ASV button color informa- 
tion 1122 indicating the display color of the button; and 
an ASV button information table 1123 indicating a but- 
ton command and the like, 

[0194] Unlike in the case of DVD-Video, the P_VOB 
1 1 02 does not have any audio data. 

(3.2.2) Data structure of the audio still video set man- 
agement information 1101 

[0195] As shown in Figure 45, the audio still video set 
management information 1101 includes audio still video 
unit Information (ASVUI) 1131 for managing a plurality 
of stiir pictures as a group and an audio still video 
search pointer table (ASV-SRPT) 1132 for managing 
the recording position of the P_VOB 1 102. 
[0196] The audio sfin video unit infdrmatrdrt 1131 IS 
information for managing a plurality of P_VOBs 1102 
having the same attritxrte and continuously recorded on 
the disk. Such information is a basic unit for reproduc- 
tion processing. 

[0197] The audio still video unit information 1131 
includes an "audio still video set ID (ASVS^ID)"; a 
"number of audio still video sets (ASVS_Ns)"; a 
"P_VOB start address (P.VOBS_SA)" and a "P_VOB 
termination address (P„VOBS_EA)" indicating the 
recording position of the P_VOB; an "ASVU attribute" 
indicating the ASVU attribute such as, for example, a 
compression method of the P_VOB, aspect mode and 
existence of a button; a "P.VOB sub-picture palette 
(P_VOBS_SP_PLT)" for determining the display color off 
the sub-picture; and "ASVU general information 
(ASVU^GI)" con^esponding to each ASVU for designat- 
ing the P_VOB belonging to each ASVU. 
[0198] Each "ASVU general information (ASVU_GI)" 
includes a "number of P_VpB (P_VOB_Ns)" indicating 
the number of P_VOBs forming the ASVU. and a "start 
P_VOB number" indicating which P_VOBs belong to the 
ASVU. 

[01 99] The aucfio still video search pointer table 1 1 32 
stores a plurality of "ASV search pointer (ASV.SRPT)" 
indicating the start address of each of the P_VOBs 
included in the ASVS. 



(3.3) Data structure of the audio title set 800 

[0200] Figure 48 shows a data structure of the audio 
title set 800 in the third example. The aucfio title set 800 
5 shown in Figure 48 has the same structure as that 
shown in Figure 5 except for the structure of the PGC 
infomnation 833. 

[0201 ] Figure 49 shows a data structure of the PGC 
information 833. The PGC information 833 includes 

10 "ATS PGC general information (ATS_PGC_GI)". an 
"ATS program information table (ATS_PQIT)". an "audio 
cell reproduction information table (ATSjC.PBIT)". and 
an "ATS audio still video reproduction information table 
(ATS_ASV_PBIT)". 

IS [0202] The "ATS PGC general Information 

(ATS_PGC_QI)" includes the number of audio pro- 
grams and the number of ceils included in the PGC 
infonnation; the reproduction time period of the PGC; 
and information the ATS_PGC information. The address 

20 infonnation on the ATS_PGC information includes 
pointer information to an "ATS program information 
table (ATS_PGIT)". an "audio cell reproduction informa- 
tion table (ATS_C_PBIT)". and an "ATS audio still video 
reproduction information table (ATS_ASV_PBIT)". 

25 [0203] The "ATS program information table 

(ATS.PGIT)" indujJes a plurality "audio program infor- 
mation (ATS.PGI)" units included In the PGC. 
[0204] Each of the plurality of "audio program informa- 
tion (ATS_PGI)" units includes "audio program physical 

30 allocation information" irxlicating whether or not the 
AOB of each program and the AOB of the previous pro- 
gram are recorded at physically discontinuous positions 
on the optical disk, "audio program time attribute infor- 
mation" indicating whether or not the time information of 

35 the AOB is continuous with the time information of the 
previous AOB, an "audio program start cell number" 
indicating the first cell number forming the audio pro- 
gram, "reproduction start audio cell time" indicating the 
first time information of the first audio cell included in tiie 

40 audio prograni. an "audio program total reproduction 
time period" indicating the reproduction time period of 
the audio program, an "audio pause time period" indi- 
cating the silent period until the reproduction of the 
audio cell of the audio program starts, an "ASVU 

45 nun*er (ASVUN)" designating the still picture unit to be 
reproduced simultaneously with audfo data of the pro- 
gram, an "audio still video display mode (ASV_DMOD)" 
indicating the display mode of tiie still picture such as. 
for example, whether the still picture or still pictures are 

so displayed in accordance with the order or randomly, and 
an -ATS_ASV_PBI start address" and "ATS_ASV_PBI 
termination address" designating corresponding ATS 
audio still video reproduction infcM'mation in the ATS 
audio still video reproduction information table 

55 (ATS_ASV_PBIT). 

[0205] Figure 50 shows a data structure of the "audio 
still video display mode (ASV_DMOD)". The **audio still 
video display mode (ASV.DMOD)* includes a "display 



21 



BNSOOCID: <EP P942609A1J.> 



41 



EP0 942 609 A1 



42 



timing mode" flag and a "display order mode" flag. 
[0206] The "display timing mode" indicates specific 
timing for reproducing the audio data and an updating 
time period of the still picture. 

[02071 When the "display timing mode" is Browsable. s 
the display timing of the still picture can be changed by 
interaction from the user. \Artien the "display timing 
mode" is SlideShow. the display timing of the still picture 
cannot be changed by interaction from the user. 
[0208] When the "display timing mode" is SlideShow. io 
the display of the still picture is updated in accordance 
with the display timing detemiined synchronously with 
the audio infomialion which is simultaneoi^ly repro- 
duced. When the "display timing mode" is Browsable. 
the display of the still picture is updated when the deter- is 
mined display continuation time period has passed, 
asynchronously from the audio information which is 
simultaneously reproduced. 

[0209] The "display order mode" indicates whether the 
still picture or still pictures are displayed sequentially in 20 
accordance witii tiie display list, randomly or shuffle. A 
random display of the still picture refers to that the still 
picture or still pictures are selected randomly while per- 
mitting overlap and are displayed in conformity with the 
selected oider. A shuffle display of the still picture refers 2S 
to that tine still picture or still pictures are selected ran- 
domly while prohibiting overlap and are displayed in 
conformity with the selected oider. 
[0210] The "audio cell reproduction information table 
(ATS_C_PBIT)" includes a plurality of "audio cell repro- 30 
duction information (ATS_,C_^PBO" units. Each "audio 
cell reproduction information unit (ATS_C_PBI)" 
includes a "cell index nunrtoer" indicating the order of 
cells included in the program, a "cell type" indicating the 
attribute of the cell (i.e.. whether the cell is a still picture 35 
cell or a silent cell), a "cell start address" indicating the 
start address of the cell in the form of a relative address 
with respect to the first pack of the AOB of the ATS 
including the cell, and a "cell termination address" indi- 
cating the final address of tiie cell in the same manner. 40 
[0211] The "ATS audio still video reproduction infor- 
mation table (ATSJVSV.PBIT)" includes a plurality of 
-ATS audio still video reproduction information 
(ATS^ASV.PBI)" units. Each "ATS audio still video 
reproduction information unit (ATS.ASV.PBI)" includes 4S 
a plurality of "display lists (DLIST)" indicating which 
P_VOBs stored in the audio still video set are repro- 
duced and in which order the P^VOBs are reproduced. 
[0212] Each "display list (DUST)" includes an "ASV 
nun*)er" indicating the ordinal number (i.e. . first, second so 
or the like) of the P„VOB in the ASVU. an "initial button 
number (FOSL_BTNN)" indicating the nun^er of a but- 
ton which is in the highlight information and selected in 
an initial state, an "audio program number" indicating 
the audio program corresponding to the DUST, "display ss 
timing" indicating tiie timing for displaying tiie P^VOB 
included in the DUST, and a "start section trarisition 
mode" and a "termination section transition mode" indi- 



cating the transition of the still picture. 
[02131 In this example, as the picture transition 
modes, "no transition", "fading from black", "fading into 
black", -cross-fading", and "wiping in several directions" 
are assumed. 



(3.4) Data structure of the AOB 802 

[021 4] The AOB 802 is packetized into 2 Kbytes. The 
AOB 802 stores data in the LPCM format. AC3 format. 
DTS format or otiier compression formats. In the case 
of the U=*CM format, the sample bit is 16. 20, or 24 bits, 
with a sampling frequency of 48 kHz. 96 kHz, 192 kHz. 
44.1 kHz. 88.2 kHz, or 176.2 kHz. 
[0215] The AOB 802 has an exemplary sti^ucture as 
described in the second example with reference to Fig- 
ure 24. 

(4) Two reproduction methods 

[0216] The audio zone region 32a stores three MPEG 
streams of a VOB, an AOB and a P^VOB. The AOB is 
included in the audio titie set (ATS). The P.VOB is 
included in the audio still video set (ASVS). The VOB is 
included in the audto manager (AMG) as shown in Fig- 
ure 44. 

[021 7] The AOB and the P_VOB are the main infbmia- 
tion stored on tine disk, and are typically music informa- 
tion with a still picture. The VOB is typically a menu for 
albwtng the user to select any music information with a 
still picture. 

[021 8] Among the MPEG streams stored in tiie audio 
zone region 32c, the VOB is reproduced by a standard 
metiiod specHied by MPEG. The AOB and tiie P^VOB 
are reproduced by an expanded different method which 
is different from the standard method. 

(4.1) Standard reproduction method 

[0219] First the standard reproduction metiiod will be 
desCTibed. This method is used fbr reproducing a VOB 
stored on the optical disk. 

[0220] Figure 51 shows a data sti^ucture of a system 
sb^eam in tiie third example conforming to MPEG. The 
optical disk stores at least one system stream. 
[0221] The system stream can include a plurality of 
elementary streams. The elementary streams include a 
video elementary stream storing moving picture infor- 
mation, an audio elementary sfream storing audio infor- 
mation, and a sub-picture elementary stream storing 
sub-picture information. The plurality off elementary 
streams are each divkled into a plurality of packs. 
[0222] The system sti-eam shown in Figure 51 
includes a vkJeo elementary stream, an audio elemen- 
tary stream, and a sub-pfcture elementary stream. The 
video elementary stream is divided into one or niore 
video packs. The audio elementary stream is divkled 
into one or more audio packs. The sub-picture elemen- 
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tary stream is divided Into one or more sub-picture 
packs. In Figure 51, the letter "V represents a video 
pacK the letter "A" represents an audio pack, and the 
letter "S" represents a sub-picture pack 
[0223] As shown in Figure 51 , each pack includes a 
"pack header", a "packet header" and a "data field". The 
data length of one pack is 2Kbyte. 
[0224] Described in the "pack header" is data con- 
forming to MPEG including, for example, a pack start 
code, an SCR (System Clock Reference), and an MUX 
(Multiplex) rate. 

[0225] Described in the "packet header" is data con- 
fimiing to MPEG including, for example, a stream ID. a 
packet length, an STD (System Target Decoder), a 
buffer scale size, and a PTS (Presentation Time 
Stamp). 

[0226] The stream ID described in the "packet header" 
indicates whether data stored In the "data field" is a 
video elementary stream or any other elementary 
stream. Any other elementary stream Is an audio ele- 
mentary stream, a sub-picture elementary stream or 
management information. 

[0227] The management infonfnation is referred to as 
an "NV pack". The management information includes a 
PCI packet and a DSI packet. The PCI packet stores 
highlight information for receiving and processing user 
interaction. The DSI packet stores information utilized 
for special effects such as. for example, fasl-fonward 
reproduction. 

[0228] In this example, the data field of the elementary 
• streams other than the management information stores 
a sub-stream ID. The sito-stream ID is an 8-bit field indi- 
cating whether the data stored in the data field is audio 
data or sub-picture data. The sub-stream ID further indi- 
cates an -encode type and a channel Identification 
number. When the data stored in the data field is audio 
data, the encode type is one of the linear PCM format, 
AC-3 fomiat, DTS fonfnat and the like, and the channel 
identification number is one of #0 through #7 (8 types 
max.). When the data stored in the data field is sub-pic- 
ture data, the channel identif ication number is one of #0 
through #31 (32 types max.). 

[0229] In the "data f iekJ". data compressed in accord- 
ance with a prescribed fbmiat is recorded. For example, 
video data is compressed by MPEG2 and recorded in 
the data field. Audio data is compressed by the linear 
PCM. AC-3 or DTS format and recorded in the data 
field. Stto-picture data Is compressed by the run-length 
coding and recorded in the data field. 
[02301 The PTS in the "pack header" and the "packet 
header" is used to synchronize the decoding of the 
audio pack and the decoding the sub-picture pack 
[0231 ] In the case where the reproduction apparatus 
reproduces a system stream recorded on the optical 
disk, the reproduction apparatus sets the SCR included 
in the leading pack of the system stream as an initial 
value of the STC. which is a reference clock, and inputs 
each pack to the conresponding decoder at time timing 



indicated by the SCR while referring to the STC. Each of 
the decoded packs is externally output from the decoder 
at the timing indicated by the PTS. By outputling each 
pack at the timing indicated by the PTS included in the 

5 pack, the synchronisation of the audio, video and sub- 
picture outputs is guaranteed. 
[0232] As described above, in the case of using the 
standard reproduction method, the system stream to be 
reproduced is multiplexed with audio information, video 

10 Information and sub-picture information. The system 
streams are reproduced by resetting the STC, which is 
a reference clock, of each system stream and externally 
outputting the audio, video and sub-picture data from 
the decoder at the timing indicated by the PTS included 

15 in each pack. Thus, the audio data, video data and sub- 
picture data are reproduced synchronously with one 
another. 



(4.2) Reproduction method of AOB and P_VOB 



so 



[0233] Hereinafter, a reproduction method of an AOB 
and a P_VOB recorded on the optical disk will be 
described. 

[0234] Figure 52 shows the relationship among the 
25 P_VOB. ASVU. Program and AOB. 

[0235] An ATS can include a plurality of PGC informa- 
tion (ATS.PGCO units. In the example shown In Figure 
52, the ATS includes one PGC information unit 
(ATS^PGCI). 

so [0236] Described in the PGC information is one or 
more audio program information (ATS^PGI) units (e.g.. 
Program #1. Program #2, ... Program #L). The audio 
program information is an audio data access unit. 
[0237] The audio program information includes one or 

35 more audio cell reproduction information (ATS_C_PBi) 
units. The audio cell reproduction information unit is a 
minimum management unit. The audio cell reproduction 
infomiation points to the position in the audio data 
stored in the AOB. Thus, the audio data to be repro- 

40 duced in relation to the audio cell reproduction mfornna- 
tion is determined. 

[0238] Also described In the PGC Information Is one 
or more ATS audio still video reproduction information 
(ATS_ASV_PBI) units. The ATS audio still video repro- 

45 duction information defines the mode in which the still 
picture is reproduced on a program-by-program basis. A 
plurality of audio program information units can share 
one ATS audio still video reproduction information unit. 
In the example shown in Figure 52, Program #1 and 

so Program #2 share ATS^ASV_PBI#1 . 

[0239] The audio still video reproduction information 
can be shared when a plurality of audio program infor- 
mation units point to a common entry in the ATS audio 
still video reproduction information table 

55 (ATS.ASV^PBIT). 

[0240] Rgure 69 shows the relationship between the 
DLIST and P^VOB, 

[0241 1 The ATS.ASV.PBI Includes a plurality of dis- 
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play lists (DLIST).and each DLIST points to the still pic- 
ture data (P_VOB) to be displayed. Usually, the still 
picture data (P_VOB) is reproduced in accordance with 
the Older of the DLIST The ATS_ASV_PBI can be des- 
ignated by the unit of the program of the ATS.PGCI. t 
The same ATS_ASV_PBI can be designated by contin- 
uous programs. The P_VOB can be designated by the 
ASVU, which is a reading unit. The same ASVU is des- 
ignated by the programs designating the same 
ATS.ASV^PBL 

[0242] In other words, continuous programs can be 
designated so as to use the same ATS^ASV^PBI with 
respect to the same ASVU. This is refenred to as the 
ASVU range. 

[0243] During the reproduction of the programs in the 
same ASVU range, the same ASVU is used. Accord- 
ingly, the still picture is not read and thus the reproduc- 
tion of audio data is not interrupted. The DLIST of the 
ATS_ASV_PBI can designate an ait>itrary P„VOB 
which is included in the same ASVU. Accordingly, the 
same P_VOB can be designated a plurality of times. 
The P_VOB in the ASVU need not be designated in the 
DLIST 

[0244] AccoiTlingly. different still pictures can be repro- 
duced while using the same ASVU among different pro- 
grams, although the ATS_ASV_PBI needs Id be 
changed. 

[0245] The audio program information designates the 
ASVU recorded in the ASVS in order to designate a plu- 
rality of still pictures (P_VOB) to be displayed simultane- 
ously with the reproduction of the AOB. 
[0246] The ASVU defines the unit by which the repro- 
duction apparatus buffers the still picture data. In other 
words, the still picture data in the designated ASVU is 
read before one audio program information unit is repro- 
duced. Accordingly, the reproduction apparatus need 
not read the still picture data from the optical disk while 
reproducing a music program. 
[0247] When reproducing the next music program 
information, the reproduction apparatus determines 
whether the plurality of pieces of still picture data indi- 
cated by the required ASVU exists in the main memory 
area or not. In the case where the plurality of pieces of 
still picture data of ASVU used in the preNnous audio 
program information exist in the main memory area, the 
reproduction apparatus need not read the still picture 
data from the optical disk. 

[0248] The disk title creators can allow the reproduc- 
tion apparatus to switch from one audio program infor- 
mation unit to the next audio program information unit 
rapidly by causing one ASVU to be shared by the two 
audio program information units. The reproduction 
apparatus can perform rapid switching from one audio 
program unit into the next audio program unit when the 
successive audio program units share the ASVU. 
[0249] Each ATS_ASV_PB1 manages the display 
order of the still pictures to be displayed by the display 
list (DLIST). In the display list (DLIST). the still picture to 



be displayed is designated by the ASV number. The 
ASV number is used for specifying the still picture 
included in the ASVU, 

[0250] Thus, the PGC information allows the still pic- 
> ture to be designated for each audio program informa- 
tion unit. Alternatively, the same still picture can be 
displayed for a plurality of audio program information 
units. Even when the aiclio program information is 
changed, the display can be changed without muting 
10 the audio data. 

[0251 1 Figure 53 shows an exemplary PGC forming a 
title. In this example, the PGC includes four aucSo pro- 
grams. Audio program #1 corresponds to AOB #1 . audio 
program #2 con^esponds to AOB #2, audio programs #3 
15 and #4 correspond to AOB #3. On the r«»rding 
medium, the AOBs are recorded in the order of AOB#1 , 
A0B#2 and AOB#3. Audio progranris #i, #2 and #3 
each has a silent cell, and audio programs #2 has two 
music cells. 

20 [0252] Audio programs #1 and #2 represent ASVU#1 . 
and audio programs #3 and #4 represent ASVU#2. 
P_VOB #1 is displayed in the ceil #2, P_VOB #2 is dis- 
played in the cell #4, P_VOB #3 is displayed in the cell 
#5. P_VOB #4 is displayed in the cell #7. and P_VOB #5 

25 is displayed in the cell #8. 

[0253] In the case where all the audio cells each have 
a reproduction time period of 60 seconds (5,400.000 In 
PTS) and all the still picture cells each have a reproduc- 
tion time period of 1 second (90.000 in PTS). audio pro- 

30 gram infomiation can be described as shown in Figure 
54: Still picture program information can be described 
as shown in Figure 55. 

[0254] Under the conditions that the audio data is 48 
kHz, 16 bit sampling with 2 channels, the number of the 
35 silent packs is 96 and the number of the audio cell pacte 
is 5760 as shown in Figure 56. Where the number of still 
picture packs is 50. the ASV search pointer is as shown 
in Figure 57. The ASVU general information is as shown 
in Figure 58. 

40 [0255] In this example, the address infonnation on the 
ASV search pointer is a relative address with respect to 
the recording position of the first P_VOB. but can be In 
any other form which specifies the position of the 
P_VOB on the optical disk. In the case where, for exam- 

45 pie. the ASVU generation information includes address 
information acting as the reference, the address infor- 
mation of the ASV search pointer can be the relative 
address with respect to the position indicated by the 
address information in the ASVU general information. 

so [0256] When the audio still video display mode is 
"SlideShow" as in the case of programs #1 and #2 
shown in Figure 54, the still picture r^roduction is 
reproduced in synchronization with the audio data. 
Since the ASVU number of the programs #1 and #2 is 

55 "1". ASVU #1 is read to the buffer before the reproduc- 
tion of the programs. Then, as shown in Figure 55, the 
still picture information #1 is referred to from the 
address information of the ATS.ASV.PBI to start the 
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display of still pictures in display lists #1 . #2 and #3 in 
the ATS audio still video reproduction infbrniation #1 at 
the time indicated by the "audio program number" and 
"cfisplay timing" of the display lists. The display timing is 
synchronous with the reproduction time period of the 
audio information to be reproduced with the still pic- 
tures. 

[0257] More specifically, the still picture in the display 
list #1 of the ATS audio still video reproduction informa- 
tion #1 is displayed when the PTS becomes 90.000 
while the AOS #1 is being reproduced. The still picture 
in the display list #2 of the ATS audio still video repro- 
duction Information #1 is displayed when the PTS 
becomes 90,000 whOe the AOB #2 is being reproduced. 
The still picture in the display list #3 of the ATS audio still 
video reproduction information #1 is displayed when the 
PTS becomes 5.580,000 while the AOB #2 is being 
reproduced. 

[0258] As described above, when the audio still video 
display mode is "SlideShow", the still picture is dis- 
played at prescribed timing synchronously with the 
reproduction of the audio data. The display timing can- 
not be changed by the interaction from the user (e.g., 
selection of a specific button by the mouse). 
[0259] Rgure 59A shows the relationship between the 
reproduction timing off the audio data and the display 
timing of the still picture when the audio still video dis- 
play mode is "SlideShow". 

[0260] By contrast, when the audio still video display 
mode is "Browsable" as in the case of programs #3 and 
#4 shown m Ftgure 54, the still picture is reproduced 
asynchronously from the audio data. Since the ASVU 
number of the programs #3 and #4 is "2". the ASVU #2 
is read to the buffer before the reproduction of the pro- 
grams. Therv still picture information #2 is referred to 
from the address information off the ATS__ASV_PBI. The 
display timing of the still pictures in display lists #1 and 
#2 in the ATS audio still video reproduction information 
#2 can be changed by the interaction from the user 
(eg., input of a convnand by the user). 
[0261 ] In the case where no interaction from the user 
is generated within the period indicated by the "display 
timing" of the display list, the time period indicated by 
the "display timing" is considered as the display contin- 
uation time period. When the display continuation time 
period has passed, the display of the next still picture is 
started. 

[0262] It is possible to designate with the audio still 
video display mode whether the still pictures are 
sequentially cfisplayed in accordance with the display 
list, the still pictures randomly selected while permitting 
overiap are reproduced (random reproduction), or the 
still pictures randomly selected while prohibiting overlap 
are reproduced (shuffle reproduction). 
[0263] Practically, when the reproduction starts with 
program #3, ASVU #2 is loaded to the kjuffer since the 
ASVU number of program #3 is "2". Then, the DLIST 
indicated by the ATS audio still video reproduction infor- 



mation #2 is referred to from the address information of 
the ATS_ASV_PBI. Since the audio program number of 
display list #1 is "3", P„VOB #4 corresponding to the 
ASV nuntber off the display list #1 is displayed. When a 
5 key conresponding to the Next_DLIST provided on the 
remote controller is pressed, the still picture of DLIST 
#2. i.e., P_VOB #5 indicated by the ASV number of 
DLIST #2 is displayed. 

[0264] The still pictures in the DLISTs are displayed in 
10 accordance with the "display effect" (i.e.. the start sec- 
tion display effect and termination section display effect, 
see Figure 55). When no user operation is performed 
within the time of 5.490.000 indicated by the display tim- 
ing of display list #1, i.e., akxnjt 1 minute (matching to 
75 the reproduction time period of program #3). the still pic- 
ture of the next DUST. i.e.. P_VOB #5 is displayed in 
accoidance with the "display effecT and the "transition 
time". The audio data off program #4 is reproduced in 
relation with the display of P_VOB #5. 
20 [0265] In the case where the r^roduction time period 
of program #3 is shorter than the time period indicated 
by the display timing of P_VOB #4. the display of 
P__VOB #4 is terminated and the display off P_VOB #5 is 
started while program #3 is being reproduced. In the 
25 case where the display time period indicated by the dis- 
play timing of P_VOB #4 is longer than the reproduction 
time period of program #3. the display dl P_VOB #5 is 
started after the reproduction of program #4 is started. 
[0266] When the reproduction is started with program 
30 #4, ASVU #2 is read as in the case of starting with pro- 
gram #3 to display the PJ/OB in the first DLIST having 
the audio program number off "4". Thereafter, the display 
of the still pictures can be changed in accordance with 
the user operations or command. The audio program 
35 mrrber of the DLIST is effective only for determining 
the P_VOB to be displayed first only when the ASVU is 
changed. When the reproduction is continued, a user 
operation or command has priority over the audio pro- 
gram number. When the P_VOB is displayed while the 
40 time period indicated by the display timing, the P_VOB 
indicated by the next DUST is displayed. 
[0267] When the value Indicated by the display timing 
refers to "infinity", the corresponding P_VOB is continu- 
ously displayed until the user operation or execution off 
45 a command is performed. As the value indicating the 
inffinity. the maximum value (e.g.. all the bit values are 
"1 ") can be used but other values are also usable. When 
the audio still video display mode is "BrowsaWe". the 
display time period of the P_VOB can always be infinite. 
so [0268] Figure 59B shows the relationship between the 
reproduction timing off the audio data and the display 
timing of the still picture when the audio still video dis- 
play mode is "BrowsaWe". 

[0269] In this example, information required for each 
55 audio programs is recorded in the audio program infor- 
mation (ATS_PGI). When the infomiation is found to 
correspond to each audio program, the information can 
be recorded in any area. For example, as shown in Fig- 
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ure 60, the ASVU number, audio still video display 
mode. ATS_ASV_PBI start address., and 
ATS_ASV_PBI termination address are recorded in the 
audio still video r^roduction information search pointer 
(ATS.PG.ASV.PBLSRP). 

[0270] As described above, the AOS and P_VOB are 
r^roduced simultaneoi^ly by decoders unlike in the 
case of the VOB. 

[02711 Hereinafter, the reproduction method of the 
VOB and the reproduction method of the AOB and 

P_VOB will be compared. 

[0272] The two reproduction methods are identical 
with each other in that video information is output along 
with the audio information. It should be noted that In the 
case of the P_VOB. the video infbrnnalion is still picture 
information including an I picture. 
[02731 One difference between the two reproduction 
methods is the recording position of the data. In the 
case of the VOB. audio information and video informa- 
tion are multiplexed together and recorded on the opti- 
cal disk as one system stream, whereas the AOB and 
the P_VOB are recorded In different areas of the optical 
disk as different system streams. 
[0274] Another difference between the two reproduc- 
tion methods is the synchronization method of audio 
data and still picture data. VOBs are reproduced by a 
decoder one by one as described above. In more detail, 
the STG. which Is a reference clock. Is reset by the SCR 
in the "pack header", and the STG is referred to output 
both audio information and still picture information at the 
timing of the PTS in the "packet header" in each pack. 
By contrast, AOBs and P.VOBs are reproduced by 
decoders simultaneously. As described in more detail 
below, a plurality of presaibed P.VOBs to be repro- 
duced synchronously with the AOB are read from the 
disk and input to the decoder b^ore the AOBs. Unlike 
the VOBs. the P_VOBs input to the decoder are not dis- 
played immediately but are held in the decoder. Regard- 
ing each P^VOB, it is considered that the STG is reset 
with the SCR of the leading pack in accordance wHh the 
MPEG decoding model and the P_VOB is decoded in 
accordance with the PTS in the packet, so that data 
after the plurality of prescribed P.VOBs to be repro- 
duced synchronously with the AOB is accumulated. 
Actually, the data regarding the P^VOB before being 
decoded is accumulated in an appropriate buffer. When 
the P_VOBs are completely input into the decoder, the 
AOB is read from the optical disk and input to the 
decoder. \A/hen the AOB is input to the decoder, the 
STC. which is a reference clock, is reset by the SCR in 
the leading pack, and the AOB is output at the timing of 
the PTS in each pack header referring to the STC as in 
the case of the VOB. 

[0275] information on the actual output tinrang of the 
P_VOBs is recorded in another area of the optical disk 
(i.e.. DUST as a part of tiie PGC information). The infor- 
mation on the output timing is separately supplied to the 
decoder. Each P_VOB in the decoder is not output syn- 
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chronously with the STC but at the display timing 
recorded in the DLIST. In other words, in reprodu^ng 
tiie AOB. the PTS which is included in tine AOB is used 
to determine the display timing of the AOB; and in repro- 
5 ducing the P_VOB. ttie information which is separately 
recorded from the P_VOB is used to determine the dis- 
play timing oif the P.VOB. 

[0276] The audio zone region and tiie DVD as a mul- 
timedia optical disk have been descra>ed. Next, a repro- 
10 duction apparatus in this example for reproducing a 
media having the above-described structure will be 
described. 

[0277] The basic structure of the reproduction appa- 
ratus in this example is the same as those described in 

IS the first and second exanrples. As in the second exam- 
ple, a key for separately controlling audio data and 
video data is provided in a renrxrte obntroner for operat- 
ing the DVD player or is provided on a front panel of the 
DVD player. VSTith such a key, tiie video data can be 

20 Skipped fonward and backward or rewound to the start of 
the video data while continuously reproducing tiie audio 
data. 

[0278] Rgure 61 is a block diagram illustrating an 
internal structure of a DVD player 90 in the third exam- 
25 pie. The DVD player 90 is different from tiie DVD player 
70 shown in Figure 8 in tiie structure of tiie AV decoder 
section, which will be described below. 
[0279] In the third exanrple. usable streams include an 
AOB as audio data, and a P_VOB as video data, and a 
30 VOB for menu or the like obtained by multiplexing audio 
and video data. An AV decoder section 85c includes a 
P_VOB system decoder 103, an AOB system decoder 
104, and a VOB system decoder 108. The AV decoder 
section 85c has a structure to operate ttie system 
35 decoders 103, 104 and 108 synchronously vwth and 
asynchronously from one another. 
[0280] The P_VOB system decoder 103 receives a 
P_VOB stream and distinguishes a stream ID and sub- 
stream ID in a header of each packet included in tiie 
40 stream, thereby classifying the data into a video packet, 
a PCI (highlight) pack^. and a sub-picture packet. 
[0281] The AOB system decoder 104 receives an 
AOB stream and classifies tiie data on a packet header- 
by-packet header basis. 
45 [0282] The VOB system decoder 1 08 receives a VOB 
stream and distinguishes a stream ID and sufc>-stream 
ID in a header of each packet included in the stream, 
thereby classifying the data into an audio packet, a 
video packet, a PCI (highlight) packet, and a sub-picture 
so packet. 

[0283] The AV decoder section 85c still includes a 
highlight buffer 94 for temporarily storing highlight infor- 
mation of a PCI packet from the P^VOB system 
decoder 103 and the VOB system decoder 108, a video 
55 buffer 96 for temporarily storing a video packet from tiie 
P^VOB system decoder 103 and the VOB system 
decoder 108, a sub-picture butter 105 for temporarily 
storing a sub-picture packet from tiie P_VOB system 
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decoder 103 and the VOB system decod©^ 108, an 
audio buffer 99 for temporarily storing an audio packet 
from the AOB system decoder 104 and the VOB system 
decoder 108, a highlight decoder 95 for decoding the 
highlight data from the highlight buffer 94 and outputling 
the decoded Nghlight data to the system control section 
93, a video decoder 87 for decoding the video data from 
the video buffer 96, a sub-picture decoder 98 for decod- 
ing the sub-picture data from the sub-picture buffer 105, 
an audio decoder 100 for decoding the audio data from 
the audfo buffer 99 and outputting the decoded audio 
data as an audio output, a video synthesizer 101 for 
synthesizing the decoding results of the video decoder 
87 and the subiDicture decoder 98 into one piece of 
video data, and a synchronization adjusting section 1 02 
for managing the synchronization of the highlight 
decoder 95, the video decoder 87, the sub-picture 
decoder 98 and the audio decoder 1 00. 
[0284] The reproduction apparatus having the above- 
descrit>ed structure operates in. for example, the follow- 
ing manner. The operation up to the reading of the 
stream is the same as described in the first and second 
examples and will not be described below. 
[0285] Figures 62 through 66 are schematic flow- 
charts illustrating an operation for reproducing the PGC 
information. 

[0286] For starting the reproduction, the system con- 
trol section 93 determines whether or not the DVD 
player 90 is in a video-oriented reproduction mode, by a 
reproduction mode determination section. When it is 
determined that the DVD player 90 is In the video-ori- 
ented reproduction mode, the system control section 93 
reads the video manager t)ased on the information 
which is read from the volume file management region. 
The system jconlfol section 93 refers to the PGC man- 
agement information table for the video manager menu 
to calculate the recording address of the PGC for the 
volume menu. The resultant PGC is reproduced and 
retained inside. When the PGC for the volume menu is 
retained inside, the system control section 93 refers to 
the retained PGC information to calculate the video 
object (VOB) to be reproduced and the recording 
address of the VOB on the optical disk When the VOB 
to be reproduced is determined, the system control sec- 
tion 93 outputs a control signal to the mechanism con- 
trol section 83 and the signal processing section 84 so 
as to retrieve the determined VOB from the optical disk 
for reproduction. When the system stream forming the 
VOB is input to the AV decoder section 85c, an instruc- 
tion indicating "reproduce VOB" as a decode stream 
instruction is given to the AV decoder section 85c. 
[0287] The VOB input to the AV decoder seclton 85c 
is divided into streams forming the VOB. i.e.. an audio 
pack, video pack, sub-picture pacK and NV pack by the 
VOB system decoder 1 08, and the streams are respec- 
tively input to the audio buffer 99, the video buffer 96, 
the sub-picture buffer 105, and the highlight buffer 94. 
The highlight buffer 95 buffers only the highlight infor- 



mation in the PCI packet in the NV pack. Data input to 
each buffer is input to the audio decoder 100, the video 
decoder 87, the sub-picture decoder 98 or the highlight 
decoder 95 to be decoded Audio data for menu is output 

5 from the audio decode 1 00. The outputs from the video 
decoder 87 and the sub-picture decoder 98 are synthe- 
sized by the video synthesizer 101 and output as video 
data. The output from the highlight decoder 95 is read to 
the system control section 93 and the button information 

10 or the like of each menu is stored in the memory in the 
system control section 93. 

[0288] Thus, a video menu from which the user can 
select the title to be reproduced O e... audio program) is 
displayed (see Figure 40). 

75 [0289] The user sees the menu and selects arxl con- 
firms the title that he/she is interested in by designating 
the item nundber in the menu using the remote control- 
ler. Then, the system control section 93 receives the 
designation of the item nun1t>er in the menu from the 

20 remote controller and refers to the button information of 
the highlight information of the PCI pack included in the 
VOB of the video menu which is being reproduced, the 
VOB being stored in the memory, to execute a control 
command corresponding to the designated number. 

25 The control command is PlayProgram #n or the like, and 
the titie number to be reproduced is designated by "n". 
[0290] As an execution operation by the PlayProgram 
command, the system control section 93 refers to the 
title search pointer table, which is a part of the audio 

30 manager, to determine the audio title set (ATS) to which 
the designated tWe belongs to and the tllte nurrtber ln 
the ATS. When the ATS is confirmed, the system control 
section 93 outputs a control signal to the mechanism 
control section 83 and the signal processing section 84 

35 so as to reproduce the ATS management information of 
the confirmed title set and sequentially retrieves ATS 
PGC information search pointer, which is a part of the 
ATS management infonnation, to determine the PGC 
infomnation including the audio program to be repro- 

40 duced. 

[0291] When the PGC information is determined, the 
system control seclton 93 outputs a control signal to the 
mechanism control section 83 and the signal process- 
ing section 84 so as to reproduce the determined PGC 

45 infonnation from the disk and retain the information in 
the inside buffer memory for the PGC information. 
[0292] When the PGC information is retained, the sys- 
tem control section 93 reproduces the PGC information 
in accordance with the flowchart shown in Figure 62, It 

so is assumed that the audio program to be produced is 
already determined by the above-described menu com- 
mand or direction designation using the remote control- 
ler. The system control section 93 refers to the retained 
PGC information to first acquire the ASVU number of 

55 the first audio program information and compares the 
nuni^er with the ASVU number previously reproduced. 
When the ASVU number is changed, the system control 
section 93 reads all the still picture data. i.e., P_VOBs 
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included in the ASVU based on the ASVU general infor- 
mation corresponding to the ASVU number and inputs 
the number into the AV decoder section 85c. Simultane- 
ously, an instruction indicating "reproduce P^VOB" is 
given to the AV decoder section 85c as a decode 
stream instruction from the system control section 93. 
The AV decoder section 85c separates the input 
p_VOBs on a pack-by-pack basis or packet-by-packet 
basis by the P_VOB system decoder 92 and stores the 
P_VOBs in corresponding buffer memories. 
[0293] At this point, the size of the video buffer 96 
needs to be larger than the sum of the sizes of the 
P_VOBs of the ASVU. For any reproduction apparatus, 
a maximum value of the total data amount of the 
P_VOBs included in the ASVU Is set in order to guaran- 
tee the reproduction. The vkJeo buffer 96 in any repro- 
duction apparatus needs to have a size accommodating 
the maximum value. In this exanrple, the maximum 
value of 2 MByte. Since an I picture is 1 00 to 200 Kbyte. 
10 to 20 I pictures can be reproduced along with the 
audio information. 

[0294] When all the P_VOBs forming the ASVU are 
completely input to the decoder, the highlight decoder 
95, the vkJeo decoder 87, and the sub-picture decoder 
98 do not perform a decoding operation. In order to 
store all the data regarding the corresponding ASVU 
into the buffers before the audto data is reproduced, the 
highlight buffer 94, the video buffer 96, and the sub-pic- 
ture buffer 105 need to have a greater buffer capacity 
than the buffer capacity specified by MPEQ2 or DVD- 
Video. 

[0295] When all the P^VOBs are completely stored in 
the corresponding buffers, the AV decoder section 85c 
and the audio decoder 100 are set to be in a decodable 
state by the audio encoding mode in the ATS PGC infor- 
mation search pointer 832 corresponding to the desig- 
nated PGC information for preparation of the 
reproduction of the audio data of the designated PGC. 
Then, the system control section 93 prepares for the 
display of the still picture. The system control section 93 
determines the ATS audio still video reproduction infor- 
mation from the ATS^ASV^PBI start address of the 
audio program information. 

[0296] When the audio still video display mode of the 
audio program information is BrowsaWe, the first DLIST 
of the ATS audio still video reproduction information 
determines the first still picture to be reproduced. When 
the audio still video display mode is SlideShow. the 
DLIST having tiie earliest display timing among a plural- 
ity of DLISTs of the ATS audio still video reproduction 
information in the range of audio programs to be repro- 
duced is selected. When the DLIST is determined, the 
system control section 93 displays the still picture, i.e., 
the P_VOB designated by the ASV number of the 
DLIST Specifically, the system control section 93 out- 
puts display control information of the still picture infor- 
mation to the synchronization adjusting section 102 in 
the AV decoder section 85c- The display control infor- 



mation includes a wait period until the I picture of the 
P_VOB to be updated is designated and the update 
thereof is displayed. When the display control section is 
input, the synchronization adjusting section 102 

5 instructs the video decoder 87 to output the designated 
I picture at the designated tin^ng in accordance with the 
display control information. Thus, the P_VOB Is dis- 
played. Unlike the AOB and VOB. the P_VOB Is output 
at the display timing recorded in a separate area. 

10 [0297] When the display of the P_yOB is started, the 
audio data designated by the audio program is repro- 
duced simultaneously. Simultaneously, the key opera- 
tion by the user is accepted. 

[0296] TTie reproduction of the audio data designated 
15 by the audio program is performed as shown in Figure 
63. First, the cell nuntber (On) to be reproduced is deter- 
mined by the ATS program inforn^tion table and the 
ATS cell reproduction information table Here, since this 
is tiie start of the operation, the cell number is 1. When 
so the cell type of tiie cell to be reproduced is a silent cell, 
processing for reproducing a silent cell is performed. 
This requires only the effective silent period corre- 
sponding to the reproduction time period of the silent 
cell. When the cell is not a silent cell, the cell is an audfo 
25 cell. Accordingly, tiie reproduction of the audio cell 
shown in Figure 65 is peirformed. In order to output the 
audio data from the leading end of the audio cell, the 
AOB to be reproduced and tiie recording address 
thereof are determined teased on the audio cell repro- 
30 duction information, and a control signal is output to the 
mechanical control section 83 and to a signal process- 
ing section 84. Thus, the reproduction of the determined 
AOB is prepared. The AOB read from the optical disk is 
input to the AV decoder section 85c. Simultaneously. 
35 the system control section 93 gives an instruction indi- 
cating "reproduce AOB" as a decode stream instruction 
to the AV decoder section 85C- The AOB is decoded 
into an audio sfream by the AOB system decoder 104 
and input to the audio Ixjffer 99 and then to the audio 
40 decoder 1 00. Thus, the AOB is prepared to be output as 
audio data. Once tiie AOB is prepared, the STC. which 
is a reference ctocK of the synchronization adjusting 
section 102 is reset by the SCR of the leading pack of 
the AOB. and the audio data in the AOB is output at tiie 
45 timing of the PTS stored in tiie packet header. When the 
output of the AOB is started, highlight information and 
sub-picture information for tiie leading 1 picture of the 
P_VOB and tiie menu items displayed in the state of 
overlapping with the leading I picture are decoded and 
so output. Although it is not guaranteed tiiat all the packets 
of the AOB include a PTS. the audio decoder outputs 
the audio data while complementing the PTS. 
[0299] When the audio still video display mode is 
Browsable while the audio data being output and the 
55 display timing of DLIST corresponding to the P_VOB 
which is being displayed reaches tiie PTS of the audio 
data wWch is being reproduced, it is determined that the 
display time period of tiie still picture has passed and 
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thus the still picture of the next DLIST is reproduced. 
When the audio still video display mode of the audio 
program is SlideShow and the audio program number of 
the next DUST is not the same as the audio program 
number of the DLIST which is being reproduced, it is 5 
determined that there is no DLIST to be reproduced and 
thus the still picture displayed is continuously displayed. 
When the next DUST is the same as the audio program 
number of the DLIST which is being reproduced, the still 
picture of the next DUST is reproduced when the dis- 10 
play timing of the next DUST reaches the PTS of the 
audio data which is being reproduced. 
[0300] Figure 66 is a flowchart illustrating the repro- 
duction of the second and later still pictures. First, the 
termination transition mode of the DLIST of the still pic- is 
ture which is being displayed is acquired. When the ter- 
mination transition mode is "no transition", the display is 
terminated. When the terniination transition mode is not 
"no transition", i.e., when the transition effect is desig- 
nated, the still picture is erased by the designated tran- 20 
sition. The designated transition is. for example, fading, 
by which the color becomes gradually lighter. It should 
be noted that the transition effect may be ignored or 
replaced with another effect unless the reproduction 
apparatus has a capability of performing the designated 25 
effect. 

[0301] When the still picture displayed is erased, the 
start section transition mode of the DLIST of the next 
still picture is. acquired. When the transition mode is "no 
transition", the next still picture is immediately dis- so 
played. When the transition rrKxSe Is not "no transition"; 
i.e.. when the transition effect is designated, the next 
still picture is displayed with an effect- Thus, the still pic- 
tures are switched. At this point, the highlight informa- 
tion and the^sub-picture information already read in the 35 
buffer are decoded as well as the video information 
Included in the P_VOB. 

[0302] The processing in response to the key opera- 
tions by the user Is performed as shown in Figure 64. 
When the key operation accompanies a change of the 40 
audio program, i.e., when the key operatton is for Next- 
Program (reproduction of the next audio program), 
PrevProgram (reproduction of the previous audio pro- 
gram), reproduction of the designated audio program, 
reproduction of the audio program by a command after 4S 
the menu is retrieved, or a change of the audio cell, the 
audio cell of the audio program to be reproduced is 
changed and processing for reproducing the audio cell 
is performed (Figure 65). 

[0303] When the key operatton by the user is for a so 
change of only the still picture, i.e., the key operation is 
for NextDLIST (display of the next DLIST), PrevDLIST 
(display of the previous still picture), or display of the 
designated DLIST. the designated still picture is 
selected and processing for reproducing the still picture ss 
is performed only when the audio still video display 
mode of the designated still picture is BrowsaWe (Figure 
66). 



[0304] In response to other key operations, the desig- 
nated operation is performed without changing the 
audio output or still picture output. Such operations 
include display of the reproduction state and switching 
of the time display mode. In order to reproduce another 
stream (VOB) such as retrieval of the menu, the audio 
output and still picture display are terminated and the 
apparatus is switched to decode the VOB. 
[0305] Thus, all the titles are reproduced and the oper- 
ation is stopped. In accordance with specific setting of 
the DVD player or the DVD, only one title can be repro- 
duced before the operation is stopped, or a menu can 
be displayed after reproduction of one or more titles is 
completed. 

[0306] Hereirrafter, the control of the video decoder 
and video buffer performed by the synchronization 
adjusting section 102 will be additionally described. 
[0307] Since data of a still picture is already stored in 
the buffer memory, the display of the still picture is man- 
aged based on the position in the buffer memory at 
which the still picture of the designated cell of the desig- 
nated program is recorded or based on the ordinal 
nuntoer (i.e.. first, second, etc.) of the still picture with 
respect to the start. When the management is per- 
formed t>ased on the position in the buff&r memory, the 
data is sent to the video decoder 87 from the designated 
address in the video buffer 96 and displayed by an 
instruction off the synchronization adjusting section 102. 
When the management is performed based on the ordi- 
nal number of the still picture, the data stored in the 
video buffer 96 ffom the leading eiwl mefeof is sent to " 
the video decoder 87 and the display Is svyritched when 
the designated ordinal nunr*er is reached. When the 
still picture is switched, display effects can be added by 
designating the transitton mode. The time to switch the 
still picture can be designated on a program-by-program 
basis before and after the display of the still picture. 
However, in the case where the reproduction apparatus 
does not have a special effect display function, the still 
picture can simply be switched with the display effects 
being ignored. 

[0308] In a synchronous mode (SlideShow), the audio 
data is decoded by the audio decoder 100, and the still 
picture, highlight and sub-picture are reproduced in 
accordance with the "display timing". The synchroniza- 
tion adjusting section 102 compares the reference time 
of the system and the "display timing" from the system 
control section 93 and control the synchronization. 
[0309] In this case, switching of only the display by the 
user is prohibited. SlideShow is effectively used, for 
exanple, for displaying lyrics along with the music and 
displaying a still picture in a moving picture. In the asyn- 
chronous mode (Browsable), audio data is not synchro- 
nized with and reproduced separately from highlight 
data, sub-picture data and still picture data. The high- 
light data, sub-picture data and still picture data are syn- 
chronized to one another, and the audio data is 
continuously reproduced in realtime based on the time 
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information of the system. The still picture is switched in 
the asyrrchronous mode by the user operation and the 
command. The user operation basically are. for exam- 
ple, an operation of continuously reproducing audio pro- 
grains while feeding display list (DLIST) Ibnward. 
backward or to the leading end; and an operation of 
feeding both audio programs and display list (DLIST) 
simultaneously fonward, backwanj or to the leading end. 
The command has similar functions. In this case, the 
-display timing- is considered as the display continua- 
tion time period of the still picture When the interaction 
from the user is not generated during the time period of 
the -display timing", a still picture is displayed based on 
the next DLIST 
1031 01 Browsatrfe is effectively used, for example, for 
displaying photos in a switching manner while music is 
reproduced and displaying various types off information 
including an explanation about the nuisic and informa- 
tion on the people involved in a switching manner. 
[031 1] The synchronous mode and the asynchronous 
mode are switched over in accordance with the picture 
program reproduction control. The audio still video dis- 
play mode off the audio program information can be des- 
ignated so that some of the audio programs included In 
the audio title are randomly selected and repeated a 
designated number of times or such audio programs are 
repeated a designated number of times prohibiting rep- 
etition of the same program (shuffle mode). 
[0312] The AV decoder section 85c can have other 
structures. 

[0313] As shown in Figure 67, tiie system decoders 
for AOB. P_VOB and VOB can be replaced with a single 
system decoder 109 having the functions of these 
decoders. Since the AOB is input at different timing from 
the P_VOB and VOB. a system decoder which is sirt>- 
stantially the same as that specified by DVD-Video is 
usable except that the buffer memory capacities of the 
highlight buffer 94, the video buffer 96 and the sub-pic- 
ture buffer 105 are increased and that a management 
mechanism for a still picture is added to control of tiie 
video buffer 96. An AV decoder section 85d shown in 
Figure 67 operates in substantially the same manner as 
the AV decoder section 85c shown in Figure 61 . 
[0314] As shown in Figure 68, the P_VOB buffer 106 
for P_VOB can be provided immediately before the AV 
decoder section 85d. The same type of AV decoder 
section as used by DVD-Video is usable. All the P^VOB 
data to be read before tiie reproduction of the audio 
data is stored in the P_VOB buffer 106. The P„VOB 
buffer 106 dynamically multiplexes the P_VOBs corre- 
sponding to the reproduction order with the audio 
stream and sends the resultant data to the AV decoder 
section 85d. Accordingly, the system decoder 109 for 
AOB and P_VOB in the AV decoder section 85d is 
required to have a processing speed which is slightiy 
higher than the speed specified by the DVD-Video 
standarcte. Streams need to be supplied to the AV 
decoder section 85d so that the audio buffer 99 does 



not underflow. 

[031 5] In tiie third example, as descrtoed above, pro- 
gram reproduction information including the start tinrie 
and reproduction time period of each piece of audio 
5 data based on the reproduction start time of ttie leading 
audio data in the MPEG2 stream is recorded in tiie 
management region as a part of the reproduction con- 
trol information. Accordingly, an optical disk for realizing 
reproduction of high quality digital audio data along witii 
10 the video data In a restricted range of bit rates is pro- 
vided. Moreover, a certain interval between audio repro- 
ductions can be maintained even In an Inexpensive 
reproduction apparatus including no video data repro- 
ductfon function. This allows titie creators to create data 



IS easily. 

[0316] Since a plurality of still pictures, sub-picture 
and menu can be displayed synchronously v«lh or asyn- 
chronously from high quality audio data, a wider variety 
of displays become available. 
20 [0317] According to the present invention, reproduc- 
tion order information defining the order off the video 
streams to be reproduced synchronously with an audfo 
sequence is recorded on a recording medium. By 
changing tiie contents of the reproduction order Infor- 
25 mation. the contents of the video streanre reproduced 
synchronously with the audio sequence can easily be 
changed. This provides the title creators with the free- 
dom of creating a variety of video streams for one audio 
sequence, and provides the user with the freedom of 
30 selecting a desired video stream among a plurality of 
video streams offered for one audfo sequence. 
[0318] According to the present invention, video 
reproduction mode information is recorded on tiie 
recoixJing medium. Whether it Is possible or not to 
35 change the onier off the video stream to be reproduced 
in synchronization wrth the audio sequence based on 
interaction from a user is adjusted by tiie video repro- 
duction mode information. The video reproduction 
mode information enables the switching of the repro- 
40 ductfon timing/i-eproduction time period of the video 
stream to be reproduced synchronously wrth the audto 
sequence. Thus, the two different types off video repro- 
duction modes, i.e.. "SlideShow" and -BrowsaWe" can 
be offered to the user. 
45 [031 9] According to the present invention, prior to the 
reproduction of the audio sequence, a video sti-eam to 
be reproduced synchronously with tiie audio sequence 
is buffered in the buffer provided in the reproduction 
apparatus. By guaranteeing the range of the recording 
50 medium to read to the buffer, reproduction by any repro- 
duction apparatus is guaranteed. As a result, titie crea- 
tors can easily assume tiie situation in which titles are 
reproduced, which facilitates the production of the tities. 
Consequently, tiie high quality tities can be supplied at 
55 lower cost. 

[0320] According to the present invention, a non-. 
MPEG stream can be decoded by an f^PEG2 decoder. 
Thus, the reproduction apparatus can be provided at 
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lower cost. 

[0321 1 Various other modifications will be apparent to 
and can be readily made by those skilled in the art with- 
out departing from the scope and spirit of this invention. 
Accordingly, it is not intended that the scope of the s 
claims appended hereto be limited to the description as 
set forth herein, but rather that the claims be broadly 
construed. 

Claims 

1 . A data storage medium having stored thereon: 

an audio sequence Including at least one audio 
stream; 

at least one video stream; and 
reproduction control information for controlling 
reproduction of the at least one audio stream 
and the at least one video stream, 
wherein the reproduction control information 
includes reproduction order information defin- 
ing the order of at least one video stream, 
among the at least one video stream stored on 
the data storage medium, which is to be r^ro- 
duced in synchronization with the audio 
sequence. 

2. A data storage medium adcbrding to claim 1, 
wherein the reproduction control information further 
includes video reproduction mode information indi- 
cating whether it is possible or not to change the 
order of the at least one video stream to be repro- 
duced in synchronisation with the audio sequence 
based on. interaction from a user. 

3. A data storage medium according to claim 1. 
wherein the reproduction control information further 
includes video reproduction mode information indi- 
cating whether reproduction timing of the at least 
one video stream to be reproduced in synchroniza- 
tion with the audio sequence is d^ined or a repro- 
duction time period thereof is defined. 

4. A data storage medium according to claim 1. 
wherein the reproduction control information further 
includes reproduction order mode information 
defining whether the at least one video stream, the 
order of which is defined by the reproduction order 
information, is reproduced randomly or sequen- 
tially. 

5. A data storage medium according to daim 4, 
wherein the reproduction order mode information 
indicates whether the at least one video stream is 
reproduced randomly while permitting overlap or 
randomly while prohitxting overlap. 

6. A data storage medium according to claim 1. 



wherein the audio sequence corresponcte to at least 
one program, and the at least one video stream 
stored on the data storage medium is grouped on a 
program-by-program basis. 

7. An apparatus for reproducing information from a 
data storage medium having stored thereon an 
audio sequence including at least one audio 
stream; at least one video stream; and reproduction 
10 control information for controlling reproduction of 
the at least one audio stream and the at least one 
video stream, wherein the reproduction control 
information includes reproduction order information 
defining the order of at least one video stream. 
15 among the at least one video stream stored on the 
data storage medium, which is to be reproduced in 
synchronization with the audio sequence, the appa- 
ratus comprising: 

so a reading section for reading the audio 

sequence and the at least one video stream 
stored on the data storage medium; and 
a reproduction section for reproducing the at 
least one video stream in synchronization with 
25 the audio sequence in the order defined by 

reproduction order information. 

a An apparatus according to daim 7. wherein the 
reproduction control information further includes 
30 video reproduction mode information indicating 
Whether iris possible Of notio change the order'Of 
the at least one video stream to be reproduced in 
synchronisation with the audio sequence based on 
interaction from a user. 

35 

9. An apparatus according to daim 7. wherein the 
reproduction control information further indudes 
video reproduction mode information indicating 
whether reproduction timing of the at least one 

40 video stream to be reproduced in synchronization 
with the audio sequence is defined or a reproduc- 
tion time period thereof is defined. 

10. An apparatus according to daim 7, wherein the 
45 reproduction control information further indudes 

reproduction order mode information defining 
whether the at least one video stream, the order of 
which is defined by the reproduction order informa- 
tion, is reproduced randomly or sequentially. 

11. An apparatus according to daim 10. wherein tine 
reproduction order mode information indicates 
whether the at least one video stream is repro- 
duced randomly while permitting overlap or ran- 

55 domly while prohibiting overlap. 

12. An apparatus according to claim 7, wherein the at 
least one video stream to be reproduced in syn- 
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chronization with the audio sequence is buff&'ed 
into a buffer located in the reproduction apparatus 
before reproduction of the audio sequence. 

13. A method for reproducing information from a data 
storage medium having stored thereon an audio 
sequence including at least one audio stream; at 
least one video stream; and r^roduction control 
information for controlling reproduction of the at 
least one audio stream and the at least one video 
stream, wherein the reproduction control informa- 
tion includes reproduction order information defin- 
ing the order of at least one video stream, among 
the at least one video stream stored on the data 
storage medium, which is to be reproduced in syn- 
chronisation with the audio sequence, the method 
conrprising the steps of: 

reading the audio sequence and the at least 
one video stream stored on the data storage 
medium; and 

reproducing the at least one video stream in 
synchronization with the audio sequence in the 
Older ddined by reproduction order informa- 
tion. 

14. A method according to daim 13, wherein the repro- 
duction control information forther includes video 
reproduction mode information indicating whether it 
is possible or not to change the order of the at least 
one video stream to be reproduced in synchroniza- 
tion with the audio sequence based on interaction 
from a user. 

15. A method according to daim 13, wherein the repro- 
duction control information forther includes video 
reproduction mode information indicating whether 
reproduction timing of the at least one video stream 
to be reproduced in synchronization with the audio 
sequence is defined or a reproduction time period 
thereof is defined. 

16. A metiiod according to daim 13. wherein the repro- 
ductiwi control information forther indudes repro- 
duction order mode information defining whether 
the at least one video stream, the order of which is 
defined by the reproduction order information, is 
reproduced randomly or sequentially. 

17- A method according to daim 16. wherein the repro- 
duction order mode information indicates whether 
the at least one video stream is reproduced ran- 
domly while permitting overlap or randomly while 
prohibiting overlap. 

18. A method according to claim 13. wherein the at 
least one video stream to be reproduced in syn- 
chronization with the audio sequence is buffered 



into a buffer located in the reproduction apparatus 
before reproduction of the audio sequence. 

19. A data storage medium stored with a first system 
5 stream and a second system stream to be repro- 
duced in synchronization with each other, wherein: 



the first system stream includes reproduction 
control information indicating timing at which 
the first system stream is reproduced, and 
the second system stream is reproduced at 
tinting determined by information other than 
information induded in the second system 
stream. 



10 



15 



20. An apparatos for reproducing a data storage 
medium stored with a first system stream and a 
second system stream to be reproduced in syn- 
chronization with each other, wherein the first sys- 
20 tem stream includes reproduction control 
information indicating timing at which the first sys- 
tem stream is reproduced, the apparatus compris- 
ing: 



25 



30 



a reading section for reading the first system 
stream and the second system stream stored 
on the data storage medium; and 
a decoder section for decoding the first system 
stream in accordance with tiie reproduction 
control information, 

wherein tiie second system stream is decoded 
in accordance with a control signal supplied 
from outside of tiie decoder section. 



35 21. A method for reproducing a data storage medium 
stored with a first system stream and a second sys- 
tem stream to be reproduced in syhchfonization 
with each other, wherein the first system stream 
Indudes reproduction control information indicating 

40 timffig at which the first system stream is repro- 
duced, tiie method comprising tiie steps of : 



reading the first system stream and the second 
system stream stored on the data storage 
medium; and 

cortrolling the timing at which the first system 
stream is reproduced in accordance with the 
reprodudion control information; 
controlling tiie tin^ng at which the second sys- 
tem stream is reproduced in accordance witii 
information other than infbrmatfon included in 
the secoTKi system stream. 
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